Feb 27 22:15:55 devstack cinder-volume[73665]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 22:15:55 devstack cinder-volume[73665]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 22:15:55 devstack cinder-volume[73665]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 22:15:55 devstack cinder-volume[73665]: INFO dbcounter [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Registered counter for database cinder Feb 27 22:15:55 devstack cinder-volume[73665]: DEBUG oslo_db.sqlalchemy.engines [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73665) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG dbcounter [-] [73665] Writer thread running {{(pid=73665) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 22:15:56 devstack cinder-volume[73665]: INFO cinder.rpc [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 22:15:56 devstack cinder-volume[73665]: INFO cinder.rpc [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_db.sqlalchemy.engines [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73665) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:15:56 devstack cinder-volume[73665]: INFO cinder.volume.manager [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Determined volume DB was empty at startup. Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG cinder.volume.manager [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73665) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Feb 27 22:15:56 devstack cinder-volume[73665]: INFO cinder.volume.manager [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 22:15:56 devstack cinder-volume[73665]: WARNING stevedore.named [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 22:15:56 devstack cinder-volume[73665]: WARNING castellan.key_manager [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 22:15:56 devstack cinder-volume[73665]: WARNING cinder.keymgr.conf_key_mgr [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG cinder.volume.drivers.lvm [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73665) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_concurrency.processutils [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_concurrency.processutils [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] CMD "cinder-rtstool verify" returned: 0 in 0.251s {{(pid=73665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_db.sqlalchemy.engines [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73665) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:15:56 devstack cinder-volume[73665]: INFO cinder.rpc [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 27 22:15:56 devstack cinder-volume[73665]: INFO cinder.rpc [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 27 22:15:56 devstack cinder-volume[73665]: WARNING stevedore.named [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 22:15:56 devstack cinder-volume[73665]: WARNING castellan.key_manager [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 22:15:56 devstack cinder-volume[73665]: INFO cinder.volume.manager [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG cinder.volume.manager [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] thread count: 2 {{(pid=73665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5475}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG cinder.volume.manager [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] thread info: [<_MainThread(MainThread, started 139720620788736)>, ] {{(pid=73665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5476}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_db.sqlalchemy.engines [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73665) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:15:56 devstack cinder-volume[73665]: INFO oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Starting 1 workers Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Started child 73767 {{(pid=73665) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Full set of CONF: {{(pid=73665) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] ******************************************************************************** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Configuration options gathered from: {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 22:15:56 devstack cinder-volume[73767]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] ================================================================================ {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] allow_availability_zone_fallback = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] allow_compression_on_image_upload = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] allowed_direct_url_schemes = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] api_rate_limit = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] auth_strategy = keystone {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] az_cache_duration = 3600 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_availability_zone = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_host = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_stats_polling_interval = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backup_api_class = cinder.backup.api.API {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backup_name_template = backup-%s {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backup_use_same_host = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backup_use_temp_snapshot = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] chap_password = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] chap_username = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_internal_tenant_project_id = 88a4152d4e924082800d99612ef16672 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_internal_tenant_user_id = 3fe6d0a3304e4a228df2becbe9ca4a7a {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cloned_volume_same_az = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cluster = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] compression_format = gzip {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] compute_api_class = cinder.compute.nova.API {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] config_dir = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] config_source = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] control_exchange = openstack {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] debug = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] default_availability_zone = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] default_group_type = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] default_volume_type = lvmdriver-1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] disk_geometry = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] driver_client_cert = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] driver_client_cert_key = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] driver_data_namespace = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] driver_ssl_cert_path = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] driver_ssl_cert_verify = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73767]: INFO cinder.volume.manager [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] driver_use_ssl = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] enable_force_upload = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] enable_new_services = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] enable_unsupported_driver = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] enforce_multipath_for_image_xfer = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] filter_function = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_api_insecure = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_api_ssl_compression = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_ca_certificates_file = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_catalog_info = image:glance:publicURL {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_certfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_keyfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_num_retries = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance_request_timeout = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] goodness_function = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] graceful_shutdown_timeout = 5 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] group_api_class = cinder.group.api.API {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] host = devstack {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_compress_on_upload = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_conversion_address_space_limit = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_conversion_cpu_limit = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_conversion_disable = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_upload_use_cinder_backend = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_upload_use_internal_tenant = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_volume_cache_enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_volume_cache_max_count = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] image_volume_cache_max_size_gb = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] init_host_max_objects_retrieval = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] instance_format = [instance: %(uuid)s] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] iscsi_target_flags = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] iscsi_write_cache = on {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] iser_helper = tgtadm {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] iser_ip_address = 192.168.122.110 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] iser_port = 3260 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_color = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_config_append = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_dir = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_file = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_options = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_rotate_interval = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_rotate_interval_type = days {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] log_rotation_type = none {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] max_age = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] max_logfile_count = 30 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] max_logfile_size_mb = 200 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] max_over_subscription_ratio = 20.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] message_reap_interval = 86400 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] message_ttl = 2592000 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] migration_create_volume_timeout_secs = 300 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] monkey_patch = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] monkey_patch_modules = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] my_ip = 192.168.122.110 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] no_snapshot_gb_quota = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] num_iser_scan_tries = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] num_shell_tries = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] num_volume_device_scan_tries = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] nvmeof_conn_info_version = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] nvmet_ns_id = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] nvmet_port_id = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] osapi_max_limit = 1000 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] osapi_volume_ext_list = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] osapi_volume_listen_port = 8776 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] osapi_volume_use_ssl = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] osapi_volume_workers = 2 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] per_volume_size_limit = -1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] periodic_fuzzy_delay = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] periodic_interval = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] public_endpoint = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] publish_errors = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] quota_backup_gigabytes = 1000 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] quota_backups = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] quota_gigabytes = 1000 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] quota_groups = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] quota_snapshots = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] quota_volumes = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] rate_limit_burst = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] rate_limit_except_level = CRITICAL {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] rate_limit_interval = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] reinit_driver_count = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] replication_device = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] report_discard_supported = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] report_interval = 120 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] reservation_clean_interval = 86400 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] reservation_expire = 86400 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] reserved_image_namespaces = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] reserved_percentage = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] rpc_response_timeout = 120 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] run_external_periodic_tasks = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] scst_target_driver = iscsi {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] scst_target_iqn_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_down_time = 720 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] shell_completion = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] snapshot_name_template = snapshot-%s {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] snapshot_same_host = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] split_loggers = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] state_path = /opt/stack/data/cinder {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] storage_availability_zone = nova {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] storage_protocol = iSCSI {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] syslog_log_facility = LOG_USER {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] target_helper = lioadm {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] target_ip_address = 192.168.122.110 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] target_port = 3260 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] target_protocol = iscsi {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] target_secondary_ip_addresses = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] trace_flags = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] transport_url = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] until_refresh = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] use_chap_auth = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] use_default_quota_class = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] use_journal = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] use_json = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] use_multipath_for_image_xfer = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] use_stderr = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] use_syslog = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] verify_glance_signatures = enabled {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_api_class = cinder.volume.api.API {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_backend_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_clear = zero {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_clear_ionice = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_clear_size = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_copy_bps_limit = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_dd_blocksize = 1M {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_name_template = volume-%s {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_service_inithost_offload = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volume_usage_audit_period = month {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] zoning_mode = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_concurrency.disable_process_locking = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.admin_password = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.admin_token = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.admin_user = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.auth_port = 35357 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.auth_protocol = https {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.auth_section = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.auth_type = password {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.auth_uri = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.auth_version = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.cache = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.certfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack sudo[73771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack sudo[73771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.identity_uri = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.include_service_catalog = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.insecure = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.interface = public {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.keyfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_password = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcache_username = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.region_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.service_type = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.backend = dogpile.cache.null {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.backend_argument = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.backend_expiration_time = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.config_prefix = cache.oslo {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.debug_cache_backend = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.enable_retry_client = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.enable_socket_keepalive = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.enforce_fips_mode = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.expiration_time = 600 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.hashclient_retry_attempts = 2 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.memcache_dead_retry = 300 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.memcache_pool_maxsize = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.memcache_sasl_enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.password = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.proxies = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.redis_db = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.redis_server = localhost:6379 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.retry_attempts = 2 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.retry_delay = 0.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.socket_keepalive_count = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.socket_keepalive_idle = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.socket_keepalive_interval = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.socket_timeout = 1.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.tls_allowed_ciphers = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.tls_cafile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.tls_certfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.tls_enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.tls_keyfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cache.username = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] coordination.backend_url = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.asyncio_connection = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.asyncio_slave_connection = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.backend = sqlalchemy {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.connection = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.connection_debug = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.connection_parameters = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.connection_recycle_time = 3600 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.connection_trace = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.db_inc_retry_interval = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.db_max_retries = 20 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.db_max_retry_interval = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.db_retry_interval = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.max_overflow = 50 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.max_pool_size = 5 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.max_retries = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.mysql_wsrep_sync_wait = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.pool_timeout = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.retry_interval = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.slave_connection = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.sqlite_synchronous = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.synchronous_reader = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] database.use_db_reconnect = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.connection_string = messaging:// {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.es_doc_type = notification {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.es_scroll_size = 10000 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.es_scroll_time = 2m {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.filter_error_trace = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.hmac_keys = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.sentinel_service_name = mymaster {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.socket_timeout = 0.1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.trace_requests = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler.trace_sqlalchemy = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler_jaeger.process_tags = {} {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler_jaeger.service_name_prefix = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] profiler_otlp.service_name_prefix = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.enforce_new_defaults = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: WARNING oslo_config.cfg [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.enforce_scope = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.policy_default_rule = default {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.policy_file = policy.yaml {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] privsep_osbrick.group = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] privsep_osbrick.helper_command = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] privsep_osbrick.user = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_sys_admin.group = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_sys_admin.helper_command = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] cinder_sys_admin.user = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.auth_section = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.auth_type = password {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.cafile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.certfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.collect_timing = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.insecure = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.keyfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.send_service_user_token = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.split_loggers = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] service_user.timeout = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.auth_section = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.auth_type = password {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.certfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.collect_timing = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.insecure = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.keyfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.region_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.split_loggers = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] glance.timeout = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.backend_availability_zone = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.chap_password = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.chap_username = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.disk_geometry = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.driver_client_cert = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.driver_client_cert_key = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.driver_data_namespace = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.driver_use_ssl = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.extra_capabilities = {} {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.filter_function = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.goodness_function = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.iscsi_target_flags = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.iscsi_write_cache = on {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.iser_helper = tgtadm {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.iser_port = 3260 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.lvm_share_target = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.lvm_type = auto {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.num_shell_tries = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.replication_device = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.report_discard_supported = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.reserved_percentage = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.target_helper = tgtadm {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.target_port = 3260 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.target_protocol = iscsi {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.trace_flags = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.unique_fqdn_network = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.use_chap_auth = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_backend_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_clear = zero {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_clear_ionice = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_clear_size = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_reports.file_event_handler = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_reports.log_dir = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.backend_host = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.chap_password = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.chap_username = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.disk_geometry = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.driver_client_cert = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.extra_capabilities = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.filter_function = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.goodness_function = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.iser_helper = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.iser_ip_address = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.iser_port = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.lvm_share_target = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.lvm_type = auto {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.num_shell_tries = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.replication_device = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.report_discard_supported = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.reserved_percentage = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.scst_target_driver = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.storage_protocol = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.target_helper = lioadm {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.target_ip_address = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.target_port = 3260 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.trace_flags = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.use_chap_auth = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_clear = zero {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_clear_size = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] lvmdriver-1.volumes_dir = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.ssl = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_notifications.driver = [] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_notifications.retry = -1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] key_manager.fixed_key = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.barbican_api_version = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.barbican_endpoint = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.barbican_endpoint_type = public {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.barbican_region_name = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.cafile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.certfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.collect_timing = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.insecure = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.keyfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.number_of_retries = 60 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.retry_delay = 1 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.send_service_user_token = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.split_loggers = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.timeout = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.verify_ssl = True {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican.verify_ssl_path = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.auth_section = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.auth_type = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.cafile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.certfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.collect_timing = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.insecure = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.keyfile = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.split_loggers = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] barbican_service_user.timeout = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.approle_role_id = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.approle_secret_id = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.kv_mountpoint = secret {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.kv_path = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.kv_version = 2 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.namespace = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.root_token_id = **** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.ssl_ca_crt_file = None {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.timeout = 60.0 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.use_ssl = False {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:15:56 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] ******************************************************************************** {{(pid=73665) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 22:15:57 devstack sudo[73771]: pam_unix(sudo:session): session closed for user root Feb 27 22:15:57 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:57 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:57 devstack sudo[73918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:15:57 devstack sudo[73918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:15:57 devstack sudo[73918]: pam_unix(sudo:session): session closed for user root Feb 27 22:15:57 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.518s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:57 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:15:57 devstack cinder-volume[73767]: INFO cinder.brick.local_dev.lvm [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 27 22:15:57 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:57 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:57 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:57 devstack sudo[74131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:15:57 devstack sudo[74131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:15:58 devstack sudo[74131]: pam_unix(sudo:session): session closed for user root Feb 27 22:15:58 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.547s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:58 devstack cinder-volume[73767]: DEBUG cinder.brick.local_dev.lvm [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73767) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 27 22:15:58 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:58 devstack sudo[74288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:15:58 devstack sudo[74288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:15:59 devstack sudo[74288]: pam_unix(sudo:session): session closed for user root Feb 27 22:15:59 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.897s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:59 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:59 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:59 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:59 devstack sudo[74396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:15:59 devstack sudo[74396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:15:59 devstack sudo[74396]: pam_unix(sudo:session): session closed for user root Feb 27 22:15:59 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.554s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:59 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:59 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:15:59 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:15:59 devstack sudo[74453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 27 22:15:59 devstack sudo[74453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:00 devstack sudo[74453]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:00 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.469s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:00 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:00 devstack sudo[74459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:16:00 devstack sudo[74459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:00 devstack sudo[74459]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:00 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:00 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:00 devstack sudo[74465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:16:00 devstack sudo[74465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:01 devstack sudo[74465]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:01 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:01 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:01 devstack sudo[74468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:16:01 devstack sudo[74468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:01 devstack sudo[74468]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:01 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:01 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:01 devstack sudo[74473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:16:01 devstack sudo[74473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:02 devstack sudo[74473]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:02 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.530s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:02 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:02 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:02 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:02 devstack sudo[74480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:16:02 devstack sudo[74480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:02 devstack sudo[74480]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:02 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.484s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:02 devstack cinder-volume[73767]: INFO cinder.volume.drivers.lvm [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 27 22:16:02 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:02 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:02 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:02 devstack sudo[74489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:16:02 devstack sudo[74489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:03 devstack sudo[74489]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:03 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.533s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:03 devstack cinder-volume[73767]: DEBUG cinder.volume.drivers.lvm [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Updating volume stats {{(pid=73767) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 22:16:03 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:03 devstack sudo[74601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:16:03 devstack sudo[74601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:03 devstack sudo[74601]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:03 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:03 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:03 devstack sudo[74739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:16:03 devstack sudo[74739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:04 devstack sudo[74739]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:04 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.535s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:04 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:04 devstack sudo[74745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:16:04 devstack sudo[74745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:04 devstack sudo[74745]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:04 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:04 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:04 devstack sudo[74749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:16:04 devstack sudo[74749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:05 devstack sudo[74749]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:05 devstack cinder-volume[73767]: INFO cinder.volume.driver [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG cinder.volume.driver [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73767) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG oslo_db.sqlalchemy.engines [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73767) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG dbcounter [-] [73767] Writer thread running {{(pid=73767) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG cinder.db.sqlalchemy.api [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Building query based on filter {{(pid=73767) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG cinder.image.image_utils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73767) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG cinder.manager [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Creating thread for {{(pid=73767) _add_to_threadpool /opt/stack/cinder/cinder/manager.py:166}} Feb 27 22:16:05 devstack cinder-volume[73767]: INFO cinder.keymgr.migration [None req-8e579108-ee4c-4859-9732-841b7e209a8c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG cinder.volume.drivers.lvm [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Updating volume stats {{(pid=73767) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:05 devstack sudo[74753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:16:05 devstack sudo[74753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:05 devstack sudo[74753]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:05 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:05 devstack sudo[74757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:16:05 devstack sudo[74757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:06 devstack sudo[74757]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:06 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:06 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:06 devstack sudo[74764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:16:06 devstack sudo[74764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:06 devstack cinder-volume[73665]: DEBUG dbcounter [-] [73665] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73665) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:16:06 devstack sudo[74764]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:06 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.530s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:06 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:06 devstack sudo[74769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:16:06 devstack sudo[74769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:07 devstack sudo[74769]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:07 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:07 devstack cinder-volume[73767]: DEBUG cinder.manager [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Notifying Schedulers of capabilities ... {{(pid=73767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:16:07 devstack cinder-volume[73767]: INFO cinder.volume.manager [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Driver initialization completed successfully. Feb 27 22:16:07 devstack cinder-volume[73767]: INFO cinder.manager [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Initiating service 2 cleanup Feb 27 22:16:07 devstack cinder-volume[73767]: INFO cinder.manager [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Service 2 cleanup completed. Feb 27 22:16:07 devstack cinder-volume[73767]: DEBUG cinder.service [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Creating RPC server for service cinder-volume {{(pid=73767) start /opt/stack/cinder/cinder/service.py:230}} Feb 27 22:16:07 devstack cinder-volume[73767]: DEBUG cinder.service [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73767) start /opt/stack/cinder/cinder/service.py:236}} Feb 27 22:16:07 devstack cinder-volume[73767]: INFO cinder.volume.manager [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 27 22:16:07 devstack cinder-volume[73767]: DEBUG cinder.volume.drivers.lvm [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Updating volume stats {{(pid=73767) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 22:16:07 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:07 devstack sudo[74774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:16:07 devstack sudo[74774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:07 devstack sudo[74774]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:07 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:07 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:07 devstack sudo[74777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:16:07 devstack sudo[74777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:08 devstack sudo[74777]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:08 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.551s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:08 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:08 devstack sudo[74838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:16:08 devstack sudo[74838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:08 devstack sudo[74838]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:08 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:08 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:16:08 devstack sudo[74841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:16:08 devstack sudo[74841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:16:09 devstack sudo[74841]: pam_unix(sudo:session): session closed for user root Feb 27 22:16:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:16:09 devstack cinder-volume[73767]: INFO cinder.volume.manager [None req-d6df2c9e-346b-4660-8b44-2a1cb8f82dc9 None None] Driver post RPC initialization completed successfully. Feb 27 22:16:09 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager._thread_info {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:16:09 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:16:09 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:16:09 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:16:09 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:16:09 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:16:09 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Feb 27 22:16:19 devstack cinder-volume[73767]: DEBUG dbcounter [-] [73767] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73767) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:16:19 devstack cinder-volume[73767]: DEBUG dbcounter [-] [73767] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73767) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:17:09 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:17:09 devstack cinder-volume[73767]: DEBUG cinder.volume.drivers.lvm [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Updating volume stats {{(pid=73767) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 22:17:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:17:09 devstack sudo[77023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:17:09 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:17:09 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root Feb 27 22:17:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:17:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:17:09 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:17:09 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:17:10 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Feb 27 22:17:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:17:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:17:10 devstack sudo[77243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:17:10 devstack sudo[77243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:17:11 devstack sudo[77243]: pam_unix(sudo:session): session closed for user root Feb 27 22:17:11 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.547s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:17:11 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:17:11 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:17:11 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:17:11 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Feb 27 22:17:11 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:17:11 devstack cinder-volume[73767]: DEBUG cinder.manager [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Notifying Schedulers of capabilities ... {{(pid=73767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:17:11 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager._thread_info {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:17:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:17:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:17:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:17:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:17:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:17:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Feb 27 22:18:09 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:18:09 devstack cinder-volume[73767]: DEBUG cinder.volume.drivers.lvm [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Updating volume stats {{(pid=73767) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 22:18:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:18:09 devstack sudo[80052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:18:09 devstack sudo[80052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:18:10 devstack sudo[80052]: pam_unix(sudo:session): session closed for user root Feb 27 22:18:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:18:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:18:10 devstack sudo[80056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:18:10 devstack sudo[80056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:18:10 devstack sudo[80056]: pam_unix(sudo:session): session closed for user root Feb 27 22:18:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.561s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:18:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:18:10 devstack sudo[80060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:18:10 devstack sudo[80060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:18:11 devstack sudo[80060]: pam_unix(sudo:session): session closed for user root Feb 27 22:18:11 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:18:11 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:18:11 devstack sudo[80063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:18:11 devstack sudo[80063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:18:11 devstack sudo[80063]: pam_unix(sudo:session): session closed for user root Feb 27 22:18:11 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:18:11 devstack cinder-volume[73767]: DEBUG cinder.manager [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Notifying Schedulers of capabilities ... {{(pid=73767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:18:11 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager._thread_info {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:18:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:18:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:18:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:18:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:18:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:18:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Feb 27 22:18:19 devstack cinder-volume[73767]: DEBUG dbcounter [-] [73767] Writing DB stats cinder:SELECT=1 {{(pid=73767) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:18:19 devstack cinder-volume[73767]: DEBUG dbcounter [-] [73767] Writing DB stats cinder:UPDATE=1 {{(pid=73767) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:19:09 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:19:09 devstack cinder-volume[73767]: DEBUG cinder.volume.drivers.lvm [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Updating volume stats {{(pid=73767) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 22:19:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:19:09 devstack sudo[81859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:19:09 devstack sudo[81859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:19:09 devstack sudo[81859]: pam_unix(sudo:session): session closed for user root Feb 27 22:19:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.530s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:19:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:19:09 devstack sudo[81864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:19:09 devstack sudo[81864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:19:10 devstack sudo[81864]: pam_unix(sudo:session): session closed for user root Feb 27 22:19:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:19:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:19:10 devstack sudo[81869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:19:10 devstack sudo[81869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:19:10 devstack sudo[81869]: pam_unix(sudo:session): session closed for user root Feb 27 22:19:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:19:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:19:10 devstack sudo[81872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:19:10 devstack sudo[81872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:19:11 devstack sudo[81872]: pam_unix(sudo:session): session closed for user root Feb 27 22:19:11 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:19:11 devstack cinder-volume[73767]: DEBUG cinder.manager [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Notifying Schedulers of capabilities ... {{(pid=73767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:19:11 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager._thread_info {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:19:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:19:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:19:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:19:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:19:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:19:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Feb 27 22:20:09 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:20:09 devstack cinder-volume[73767]: DEBUG cinder.volume.drivers.lvm [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Updating volume stats {{(pid=73767) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 22:20:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:09 devstack sudo[82766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 22:20:09 devstack sudo[82766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:09 devstack sudo[82766]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:09 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:09 devstack sudo[82835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:20:09 devstack sudo[82835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:10 devstack sudo[82835]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:10 devstack sudo[82853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 22:20:10 devstack sudo[82853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:10 devstack sudo[82853]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:10 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:10 devstack sudo[82875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 22:20:10 devstack sudo[82875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:11 devstack sudo[82875]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:11 devstack cinder-volume[73767]: DEBUG oslo_concurrency.processutils [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=73767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:11 devstack cinder-volume[73767]: DEBUG cinder.manager [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Notifying Schedulers of capabilities ... {{(pid=73767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:20:11 devstack cinder-volume[73767]: DEBUG oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Running periodic task VolumeManager._thread_info {{(pid=73767) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:20:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task [None req-4d2afb07-500f-47fc-9304-3df90768a4bb None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:20:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:20:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:20:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:20:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:20:11 devstack cinder-volume[73767]: ERROR oslo_service.periodic_task Feb 27 22:20:13 devstack cinder-volume[73665]: INFO oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Caught SIGTERM, stopping children Feb 27 22:20:13 devstack cinder-volume[73665]: DEBUG oslo_concurrency.lockutils [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Acquiring lock "singleton_lock" {{(pid=73665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 22:20:13 devstack cinder-volume[73665]: DEBUG oslo_concurrency.lockutils [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Acquired lock "singleton_lock" {{(pid=73665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 22:20:13 devstack cinder-volume[73665]: DEBUG oslo_concurrency.lockutils [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Releasing lock "singleton_lock" {{(pid=73665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 22:20:13 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Stop services. {{(pid=73665) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 22:20:13 devstack cinder-volume[73665]: DEBUG oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Killing children. {{(pid=73665) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 22:20:13 devstack cinder-volume[73665]: INFO oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Waiting on 1 children to exit Feb 27 22:20:17 devstack cinder-volume[73767]: DEBUG oslo_concurrency.lockutils [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Acquiring lock "singleton_lock" {{(pid=73767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 22:20:17 devstack cinder-volume[73767]: DEBUG oslo_concurrency.lockutils [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Acquired lock "singleton_lock" {{(pid=73767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 22:20:17 devstack cinder-volume[73767]: DEBUG oslo_concurrency.lockutils [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Releasing lock "singleton_lock" {{(pid=73767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 22:20:17 devstack cinder-volume[73767]: WARNING amqp [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 22:20:17 devstack cinder-volume[73767]: WARNING amqp [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 22:20:17 devstack cinder-volume[73665]: INFO oslo_service.backend._eventlet.service [None req-ec8553f0-1006-4a1e-9155-59c7772d7b82 None None] Child 73767 exited with status 0 Feb 27 22:20:19 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 22:20:19 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 22:20:19 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 22:20:20 devstack cinder-volume[83005]: INFO dbcounter [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Registered counter for database cinder Feb 27 22:20:20 devstack cinder-volume[83005]: DEBUG oslo_db.sqlalchemy.engines [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:20:20 devstack cinder-volume[83005]: DEBUG dbcounter [-] [83005] Writer thread running {{(pid=83005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 22:20:20 devstack cinder-volume[83005]: INFO cinder.rpc [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 22:20:20 devstack cinder-volume[83005]: INFO cinder.rpc [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 22:20:20 devstack cinder-volume[83005]: DEBUG oslo_db.sqlalchemy.engines [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:20:20 devstack cinder-volume[83005]: INFO cinder.volume.manager [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Determined volume DB was empty at startup. Feb 27 22:20:20 devstack cinder-volume[83005]: DEBUG cinder.volume.manager [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83005) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Feb 27 22:20:20 devstack cinder-volume[83005]: INFO cinder.volume.manager [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 22:20:20 devstack cinder-volume[83005]: WARNING stevedore.named [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 22:20:20 devstack cinder-volume[83005]: WARNING castellan.key_manager [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 22:20:20 devstack cinder-volume[83005]: WARNING cinder.keymgr.conf_key_mgr [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 22:20:21 devstack cinder-volume[83005]: INFO cinder.volume.manager [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG cinder.volume.manager [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] thread count: 2 {{(pid=83005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5475}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG cinder.volume.manager [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] thread info: [<_MainThread(MainThread, started 140048950041024)>, ] {{(pid=83005) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5476}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_db.sqlalchemy.engines [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:20:21 devstack cinder-volume[83005]: INFO oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Starting 1 workers Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Started child 83124 {{(pid=83005) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Full set of CONF: {{(pid=83005) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] ******************************************************************************** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Configuration options gathered from: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] ================================================================================ {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 22:20:21 devstack cinder-volume[83124]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] allow_availability_zone_fallback = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] allow_compression_on_image_upload = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] allowed_direct_url_schemes = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] api_rate_limit = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] auth_strategy = keystone {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_availability_zone = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_host = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_stats_polling_interval = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backup_api_class = cinder.backup.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backup_name_template = backup-%s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backup_use_same_host = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backup_use_temp_snapshot = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] chap_password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] chap_username = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_internal_tenant_project_id = 88a4152d4e924082800d99612ef16672 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_internal_tenant_user_id = 3fe6d0a3304e4a228df2becbe9ca4a7a {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cluster = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] compression_format = gzip {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] compute_api_class = cinder.compute.nova.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] config_dir = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] config_source = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] control_exchange = openstack {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] debug = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] default_availability_zone = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] default_group_type = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] default_volume_type = QuobyteHD {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] disk_geometry = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] driver_client_cert = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] driver_client_cert_key = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] driver_data_namespace = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] driver_ssl_cert_path = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] driver_ssl_cert_verify = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] driver_use_ssl = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] enable_new_services = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] enable_unsupported_driver = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] enabled_backends = ['QuobyteHD'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] enforce_multipath_for_image_xfer = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] filter_function = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_api_insecure = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_api_ssl_compression = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_ca_certificates_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_catalog_info = image:glance:publicURL {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_num_retries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance_request_timeout = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] goodness_function = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] graceful_shutdown_timeout = 5 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] group_api_class = cinder.group.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] host = devstack {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_compress_on_upload = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_conversion_address_space_limit = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_conversion_cpu_limit = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_conversion_disable = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_upload_use_cinder_backend = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_upload_use_internal_tenant = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_volume_cache_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_volume_cache_max_count = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] image_volume_cache_max_size_gb = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83124]: INFO cinder.volume.manager [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] init_host_max_objects_retrieval = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.remotefs [None req-fe83a55c-5012-4644-9084-501554dff855 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83124) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] instance_format = [instance: %(uuid)s] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] iscsi_target_flags = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] iscsi_write_cache = on {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] iser_helper = tgtadm {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] iser_ip_address = 192.168.122.110 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] iser_port = 3260 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_color = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_config_append = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_dir = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_options = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_rotate_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_rotate_interval_type = days {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] log_rotation_type = none {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] max_age = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] max_logfile_count = 30 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] max_logfile_size_mb = 200 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] max_over_subscription_ratio = 20.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] message_reap_interval = 86400 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] message_ttl = 2592000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] migration_create_volume_timeout_secs = 300 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] monkey_patch = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] monkey_patch_modules = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] my_ip = 192.168.122.110 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] no_snapshot_gb_quota = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] num_iser_scan_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] num_shell_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] num_volume_device_scan_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] nvmeof_conn_info_version = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] nvmet_ns_id = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] nvmet_port_id = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] osapi_max_limit = 1000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] osapi_volume_ext_list = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] osapi_volume_listen = 0.0.0.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] osapi_volume_listen_port = 8776 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] osapi_volume_use_ssl = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] osapi_volume_workers = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] per_volume_size_limit = -1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] periodic_fuzzy_delay = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] periodic_interval = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] project_id_regex = [0-9a-f\-]+ {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] public_endpoint = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] publish_errors = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] quota_backup_gigabytes = 1000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] quota_backups = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] quota_gigabytes = 1000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] quota_groups = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] quota_snapshots = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] quota_volumes = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] rate_limit_burst = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] rate_limit_except_level = CRITICAL {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] rate_limit_interval = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] reinit_driver_count = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] replication_device = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] report_discard_supported = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] report_interval = 120 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] reservation_clean_interval = 86400 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] reservation_expire = 86400 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] reserved_image_namespaces = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] reserved_percentage = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] rpc_response_timeout = 120 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] run_external_periodic_tasks = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] scst_target_driver = iscsi {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] scst_target_iqn_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_down_time = 720 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] shell_completion = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] snapshot_name_template = snapshot-%s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] split_loggers = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] state_path = /opt/stack/data/cinder {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] storage_availability_zone = nova {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] storage_protocol = iSCSI {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] syslog_log_facility = LOG_USER {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] target_helper = lioadm {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] target_ip_address = 192.168.122.110 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] target_port = 3260 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] target_protocol = iscsi {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] target_secondary_ip_addresses = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] trace_flags = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] transfer_api_class = cinder.transfer.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] transport_url = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] until_refresh = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] use_chap_auth = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] use_default_quota_class = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] use_journal = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] use_json = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] use_multipath_for_image_xfer = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] use_stderr = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] use_syslog = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] verify_glance_signatures = enabled {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_api_class = cinder.volume.api.API {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_backend_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_clear = zero {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_clear_ionice = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_clear_size = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83124) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 22:20:21 devstack cinder-volume[83124]: WARNING cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 22:20:21 devstack cinder-volume[83124]: WARNING cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_copy_bps_limit = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_dd_blocksize = 1M {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Running cmd (subprocess): mount.quobyte {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_name_template = volume-%s {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_service_inithost_offload = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volume_usage_audit_period = month {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] zoning_mode = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_concurrency.disable_process_locking = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.admin_password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.admin_token = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.admin_user = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.auth_admin_prefix = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.auth_port = 35357 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.auth_protocol = https {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.auth_section = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.auth_type = password {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.auth_uri = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.auth_version = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.cache = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.delay_auth_decision = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.http_connect_timeout = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.identity_uri = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.include_service_catalog = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.insecure = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.interface = public {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_password = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcache_username = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.region_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.service_token_roles_required = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.service_type = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.token_cache_time = 300 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.backend = dogpile.cache.null {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.backend_argument = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.backend_expiration_time = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.config_prefix = cache.oslo {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.debug_cache_backend = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.enable_retry_client = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.enable_socket_keepalive = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.enforce_fips_mode = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.expiration_time = 600 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.hashclient_retry_attempts = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.memcache_dead_retry = 300 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.memcache_pool_maxsize = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.memcache_sasl_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.proxies = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.redis_db = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.redis_sentinel_service_name = mymaster {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.redis_server = localhost:6379 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.retry_attempts = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.retry_delay = 0.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.socket_keepalive_count = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.socket_keepalive_idle = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.socket_keepalive_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.socket_timeout = 1.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.tls_allowed_ciphers = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.tls_cafile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.tls_certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.tls_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.tls_keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cache.username = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] coordination.backend_url = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.asyncio_connection = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.asyncio_slave_connection = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.backend = sqlalchemy {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.connection = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.connection_debug = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.connection_parameters = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.connection_recycle_time = 3600 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.connection_trace = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.db_inc_retry_interval = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.db_max_retries = 20 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.db_max_retry_interval = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.db_retry_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.max_overflow = 50 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.max_pool_size = 5 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.max_retries = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.mysql_wsrep_sync_wait = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.pool_timeout = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.retry_interval = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.slave_connection = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.sqlite_synchronous = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.synchronous_reader = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] database.use_db_reconnect = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack quobyte-client[83125]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 22:20:21 devstack quobyte-client[83125]: Invalid parameters found, error: missing mount point. Feb 27 22:20:21 devstack quobyte-client[83125]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 22:20:21 devstack quobyte-client[83125]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.connection_string = messaging:// {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.es_doc_type = notification {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.es_scroll_size = 10000 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.es_scroll_time = 2m {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.filter_error_trace = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.hmac_keys = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.sentinel_service_name = mymaster {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83124]: INFO cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 ... Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.socket_timeout = 0.1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 -c /etc/quobyte/client-cinder.cfg {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.trace_requests = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler.trace_sqlalchemy = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler_jaeger.process_tags = {} {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler_jaeger.service_name_prefix = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] profiler_otlp.service_name_prefix = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.enforce_new_defaults = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: WARNING oslo_config.cfg [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.enforce_scope = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.policy_default_rule = default {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.policy_file = policy.yaml {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_policy.remote_timeout = 60.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] privsep_osbrick.group = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] privsep_osbrick.helper_command = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] privsep_osbrick.user = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_sys_admin.group = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_sys_admin.helper_command = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] cinder_sys_admin.user = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.auth_section = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.auth_type = password {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.cafile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack sudo[83126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 -c /etc/quobyte/client-cinder.cfg Feb 27 22:20:21 devstack sudo[83126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.collect_timing = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.insecure = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.send_service_user_token = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.split_loggers = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] service_user.timeout = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.auth_section = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.auth_type = password {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.collect_timing = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.insecure = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.region_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.split_loggers = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] glance.timeout = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.backend_availability_zone = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.chap_password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.chap_username = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.disk_geometry = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.driver_client_cert = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.driver_client_cert_key = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.driver_data_namespace = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.driver_use_ssl = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.enable_unsupported_driver = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.extra_capabilities = {} {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.filter_function = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.goodness_function = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.iscsi_target_flags = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.iscsi_write_cache = on {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.iser_helper = tgtadm {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.iser_port = 3260 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_host = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_login = admin {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_mount_options = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_private_key = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_share_path = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_ssh_port = 22 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.num_shell_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.nvmet_port_id = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.quobyte_client_cfg = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.quobyte_volume_url = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.replication_device = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.report_discard_supported = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.reserved_percentage = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.scst_target_driver = iscsi {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.scst_target_iqn_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.storage_protocol = iSCSI {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.target_helper = tgtadm {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.target_port = 3260 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.target_protocol = iscsi {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.trace_flags = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.unique_fqdn_network = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.use_chap_auth = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volume_backend_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volume_clear = zero {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volume_clear_ionice = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volume_clear_size = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_reports.file_event_handler = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_reports.log_dir = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.backend_availability_zone = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.backend_host = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.chap_password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.chap_username = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.chiscsi_conf = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.disk_geometry = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.driver_client_cert = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.driver_client_cert_key = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.driver_data_namespace = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.driver_use_ssl = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.extra_capabilities = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.filter_function = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.goodness_function = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.iscsi_target_flags = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.iscsi_write_cache = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.iser_helper = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.iser_ip_address = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.iser_port = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.iser_target_prefix = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_host = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_login = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_mount_options = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_password = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_private_key = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_share_path = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_ssh_port = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.num_shell_tries = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nvmet_ns_id = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.nvmet_port_id = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.replication_device = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.report_discard_supported = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.reserved_percentage = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.scst_target_driver = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.storage_protocol = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.target_helper = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.target_ip_address = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.target_port = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.target_prefix = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.target_protocol = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.trace_flags = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.unique_fqdn_network = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.use_chap_auth = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volume_clear = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volume_clear_ionice = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volume_clear_size = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] QuobyteHD.volumes_dir = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.ssl = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.ssl_version = {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_notifications.driver = [] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_notifications.retry = -1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] oslo_messaging_notifications.transport_url = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] key_manager.fixed_key = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.barbican_api_version = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.barbican_endpoint = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.barbican_endpoint_type = public {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.barbican_region_name = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.cafile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.collect_timing = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.insecure = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.number_of_retries = 60 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.retry_delay = 1 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.send_service_user_token = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.split_loggers = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.timeout = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.verify_ssl = True {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican.verify_ssl_path = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.auth_section = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.auth_type = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.cafile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.certfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.collect_timing = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.insecure = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.keyfile = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.split_loggers = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] barbican_service_user.timeout = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.approle_role_id = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.approle_secret_id = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.kv_mountpoint = secret {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.kv_path = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.kv_version = 2 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.namespace = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.root_token_id = **** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.ssl_ca_crt_file = None {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.timeout = 60.0 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.use_ssl = False {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:21 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] ******************************************************************************** {{(pid=83005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 22:20:21 devstack sudo[83126]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.532s {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:21 devstack cinder-volume[83124]: INFO cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 succeeded Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.539s {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:20:21 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:21 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:20:21 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:22 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.401s {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:22 devstack cinder-volume[83124]: INFO cinder.volume.driver [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.volume.driver [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5657577514648, 'free_capacity_gb': 1775.5657577514648, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83124) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_db.sqlalchemy.engines [None req-fe83a55c-5012-4644-9084-501554dff855 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG dbcounter [-] [83124] Writer thread running {{(pid=83124) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.db.sqlalchemy.api [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Building query based on filter {{(pid=83124) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.image.image_utils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83124) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.manager [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Creating thread for {{(pid=83124) _add_to_threadpool /opt/stack/cinder/cinder/manager.py:166}} Feb 27 22:20:22 devstack cinder-volume[83124]: INFO cinder.keymgr.migration [None req-c82c8c65-1a81-478f-b23e-bcecb501cf3f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:22 devstack sudo[83198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:20:22 devstack sudo[83198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:22 devstack sudo[83198]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.431s {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.manager [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Notifying Schedulers of capabilities ... {{(pid=83124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:20:22 devstack cinder-volume[83124]: INFO cinder.volume.manager [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Driver initialization completed successfully. Feb 27 22:20:22 devstack cinder-volume[83124]: INFO cinder.manager [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Initiating service 3 cleanup Feb 27 22:20:22 devstack cinder-volume[83124]: INFO cinder.manager [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Service 3 cleanup completed. Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.service [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Creating RPC server for service cinder-volume {{(pid=83124) start /opt/stack/cinder/cinder/service.py:230}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.service [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83124) start /opt/stack/cinder/cinder/service.py:236}} Feb 27 22:20:22 devstack cinder-volume[83124]: INFO cinder.volume.manager [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:20:22 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:22 devstack sudo[83204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:20:22 devstack sudo[83204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:23 devstack sudo[83204]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:23 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-fe83a55c-5012-4644-9084-501554dff855 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.434s {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:23 devstack cinder-volume[83124]: INFO cinder.volume.manager [None req-fe83a55c-5012-4644-9084-501554dff855 None None] Driver post RPC initialization completed successfully. Feb 27 22:20:27 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-0a9eeb5e-00b7-4099-8461-d8790ee2875b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:20:27 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-0a9eeb5e-00b7-4099-8461-d8790ee2875b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:20:27 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-0a9eeb5e-00b7-4099-8461-d8790ee2875b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:20:27 devstack cinder-volume[83124]: DEBUG cinder.volume.drivers.quobyte [None req-0a9eeb5e-00b7-4099-8461-d8790ee2875b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:20:27 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-0a9eeb5e-00b7-4099-8461-d8790ee2875b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83124) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:20:27 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-0a9eeb5e-00b7-4099-8461-d8790ee2875b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:27 devstack sudo[83268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:20:27 devstack sudo[83268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:27 devstack sudo[83268]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:27 devstack cinder-volume[83124]: DEBUG oslo_concurrency.processutils [None req-0a9eeb5e-00b7-4099-8461-d8790ee2875b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.384s {{(pid=83124) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:27 devstack cinder-volume[83124]: DEBUG cinder.manager [None req-0a9eeb5e-00b7-4099-8461-d8790ee2875b None None] Notifying Schedulers of capabilities ... {{(pid=83124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:20:31 devstack cinder-volume[83005]: DEBUG dbcounter [-] [83005] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:20:31 devstack cinder-volume[83005]: INFO oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Caught SIGTERM, stopping children Feb 27 22:20:31 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Acquiring lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 22:20:31 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Acquired lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 22:20:31 devstack cinder-volume[83005]: DEBUG oslo_concurrency.lockutils [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Releasing lock "singleton_lock" {{(pid=83005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 22:20:31 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Stop services. {{(pid=83005) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 22:20:31 devstack cinder-volume[83005]: DEBUG oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Killing children. {{(pid=83005) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 22:20:31 devstack cinder-volume[83005]: INFO oslo_service.backend._eventlet.service [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Waiting on 1 children to exit Feb 27 22:20:33 devstack cinder-volume[83124]: DEBUG dbcounter [-] [83124] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83124) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:20:33 devstack cinder-volume[83124]: DEBUG dbcounter [-] [83124] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=83124) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:20:36 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Acquiring lock "singleton_lock" {{(pid=83124) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 22:20:36 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Acquired lock "singleton_lock" {{(pid=83124) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 22:20:36 devstack cinder-volume[83124]: DEBUG oslo_concurrency.lockutils [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Releasing lock "singleton_lock" {{(pid=83124) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 22:20:36 devstack cinder-volume[83124]: WARNING amqp [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 22:20:36 devstack cinder-volume[83124]: WARNING amqp [None req-c18ddb6d-2010-40fc-8ac7-5777d4c2a0bd None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 22:20:38 devstack cinder-volume[83376]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 22:20:38 devstack cinder-volume[83376]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 22:20:38 devstack cinder-volume[83376]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83376) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 22:20:38 devstack cinder-volume[83376]: INFO dbcounter [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Registered counter for database cinder Feb 27 22:20:38 devstack cinder-volume[83376]: DEBUG oslo_db.sqlalchemy.engines [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83376) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG dbcounter [-] [83376] Writer thread running {{(pid=83376) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 22:20:39 devstack cinder-volume[83376]: INFO cinder.rpc [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 22:20:39 devstack cinder-volume[83376]: INFO cinder.rpc [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_db.sqlalchemy.engines [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83376) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:20:39 devstack cinder-volume[83376]: INFO cinder.volume.manager [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Determined volume DB was empty at startup. Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG cinder.volume.manager [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83376) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Feb 27 22:20:39 devstack cinder-volume[83376]: WARNING stevedore.named [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 22:20:39 devstack cinder-volume[83376]: WARNING castellan.key_manager [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 22:20:39 devstack cinder-volume[83376]: WARNING cinder.keymgr.conf_key_mgr [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 22:20:39 devstack cinder-volume[83376]: INFO cinder.volume.manager [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG cinder.volume.manager [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] thread count: 2 {{(pid=83376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5475}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG cinder.volume.manager [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] thread info: [<_MainThread(MainThread, started 139970429307840)>, ] {{(pid=83376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5476}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_db.sqlalchemy.engines [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83376) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:20:39 devstack cinder-volume[83376]: INFO oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Starting 1 workers Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Started child 83540 {{(pid=83376) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Full set of CONF: {{(pid=83376) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] ******************************************************************************** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Configuration options gathered from: {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] ================================================================================ {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 22:20:39 devstack cinder-volume[83540]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] allow_availability_zone_fallback = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] allow_compression_on_image_upload = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] allowed_direct_url_schemes = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] api_rate_limit = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] auth_strategy = keystone {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_availability_zone = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_host = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_stats_polling_interval = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backup_api_class = cinder.backup.api.API {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backup_name_template = backup-%s {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backup_use_same_host = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backup_use_temp_snapshot = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] chap_password = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] chap_username = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_internal_tenant_project_id = 88a4152d4e924082800d99612ef16672 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_internal_tenant_user_id = 3fe6d0a3304e4a228df2becbe9ca4a7a {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cluster = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] compression_format = gzip {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] compute_api_class = cinder.compute.nova.API {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] config_dir = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] config_source = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] control_exchange = openstack {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] debug = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] default_availability_zone = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] default_group_type = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] default_volume_type = QuobyteHD {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] disk_geometry = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] driver_client_cert = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] driver_client_cert_key = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] driver_data_namespace = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] driver_ssl_cert_path = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] driver_ssl_cert_verify = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] driver_use_ssl = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] enable_new_services = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] enable_unsupported_driver = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] enabled_backends = ['QuobyteHD'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] enforce_multipath_for_image_xfer = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] filter_function = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_api_insecure = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_api_ssl_compression = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_ca_certificates_file = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_catalog_info = image:glance:publicURL {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_certfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_keyfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_num_retries = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance_request_timeout = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] goodness_function = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] graceful_shutdown_timeout = 5 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] group_api_class = cinder.group.api.API {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] host = devstack {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_compress_on_upload = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_conversion_address_space_limit = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_conversion_cpu_limit = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_conversion_disable = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_upload_use_cinder_backend = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_upload_use_internal_tenant = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_volume_cache_enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_volume_cache_max_count = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] image_volume_cache_max_size_gb = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] init_host_max_objects_retrieval = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] instance_format = [instance: %(uuid)s] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] iscsi_target_flags = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] iscsi_write_cache = on {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] iser_helper = tgtadm {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] iser_ip_address = 192.168.122.110 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] iser_port = 3260 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_color = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_config_append = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83540) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_dir = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_file = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_options = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_rotate_interval = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_rotate_interval_type = days {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] log_rotation_type = none {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] max_age = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] max_logfile_count = 30 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] max_logfile_size_mb = 200 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] max_over_subscription_ratio = 20.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] message_reap_interval = 86400 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] message_ttl = 2592000 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] migration_create_volume_timeout_secs = 300 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] monkey_patch = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] monkey_patch_modules = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] my_ip = 192.168.122.110 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] no_snapshot_gb_quota = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] num_iser_scan_tries = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] num_shell_tries = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] num_volume_device_scan_tries = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] nvmeof_conn_info_version = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] nvmet_ns_id = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] nvmet_port_id = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] osapi_max_limit = 1000 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] osapi_volume_ext_list = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] osapi_volume_listen_port = 8776 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] osapi_volume_use_ssl = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] osapi_volume_workers = 2 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] per_volume_size_limit = -1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] periodic_fuzzy_delay = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] periodic_interval = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] public_endpoint = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] publish_errors = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] quota_backup_gigabytes = 1000 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] quota_backups = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] quota_gigabytes = 1000 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] quota_groups = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] quota_snapshots = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] quota_volumes = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] rate_limit_burst = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] rate_limit_except_level = CRITICAL {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] rate_limit_interval = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] reinit_driver_count = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] replication_device = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] report_discard_supported = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] report_interval = 120 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] reservation_clean_interval = 86400 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] reservation_expire = 86400 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] reserved_image_namespaces = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] reserved_percentage = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] rpc_response_timeout = 120 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] run_external_periodic_tasks = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] scst_target_driver = iscsi {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] scst_target_iqn_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_down_time = 720 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] shell_completion = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] snapshot_name_template = snapshot-%s {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] split_loggers = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] state_path = /opt/stack/data/cinder {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] storage_availability_zone = nova {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] storage_protocol = iSCSI {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] syslog_log_facility = LOG_USER {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] target_helper = lioadm {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] target_ip_address = 192.168.122.110 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] target_port = 3260 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] target_protocol = iscsi {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] target_secondary_ip_addresses = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] trace_flags = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] transport_url = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] until_refresh = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] use_chap_auth = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] use_default_quota_class = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] use_journal = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] use_json = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] use_multipath_for_image_xfer = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] use_stderr = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] use_syslog = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] verify_glance_signatures = enabled {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_api_class = cinder.volume.api.API {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_backend_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_clear = zero {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_clear_ionice = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_clear_size = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_copy_bps_limit = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_dd_blocksize = 1M {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_name_template = volume-%s {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_service_inithost_offload = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volume_usage_audit_period = month {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] zoning_mode = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_concurrency.disable_process_locking = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.admin_password = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.admin_token = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.admin_user = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.auth_port = 35357 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.auth_protocol = https {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.auth_section = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.auth_type = password {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.auth_uri = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.auth_version = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.cache = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.certfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.identity_uri = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.include_service_catalog = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.insecure = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.interface = public {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.keyfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_password = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcache_username = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.region_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.service_type = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.backend = dogpile.cache.null {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.backend_argument = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.backend_expiration_time = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.config_prefix = cache.oslo {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.debug_cache_backend = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83540) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.enable_retry_client = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.enable_socket_keepalive = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.enforce_fips_mode = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.expiration_time = 600 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.hashclient_retry_attempts = 2 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.memcache_dead_retry = 300 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.memcache_pool_maxsize = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.memcache_sasl_enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.password = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.proxies = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Running cmd (subprocess): mount.quobyte {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.redis_db = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.redis_server = localhost:6379 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.retry_attempts = 2 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.retry_delay = 0.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.socket_keepalive_count = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.socket_keepalive_idle = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.socket_keepalive_interval = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.socket_timeout = 1.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.tls_allowed_ciphers = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.tls_cafile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.tls_certfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.tls_enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.tls_keyfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cache.username = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] coordination.backend_url = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.asyncio_connection = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.asyncio_slave_connection = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.backend = sqlalchemy {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.connection = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.connection_debug = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.connection_parameters = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.connection_recycle_time = 3600 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.connection_trace = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.db_inc_retry_interval = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.db_max_retries = 20 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.db_max_retry_interval = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.db_retry_interval = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.max_overflow = 50 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.max_pool_size = 5 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.max_retries = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.mysql_wsrep_sync_wait = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.pool_timeout = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.retry_interval = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.slave_connection = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.sqlite_synchronous = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.synchronous_reader = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] database.use_db_reconnect = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.connection_string = messaging:// {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.es_doc_type = notification {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.es_scroll_size = 10000 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.es_scroll_time = 2m {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.filter_error_trace = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.hmac_keys = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.sentinel_service_name = mymaster {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.socket_timeout = 0.1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.trace_requests = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler.trace_sqlalchemy = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler_jaeger.process_tags = {} {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler_jaeger.service_name_prefix = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] profiler_otlp.service_name_prefix = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.enforce_new_defaults = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: WARNING oslo_config.cfg [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.enforce_scope = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.policy_default_rule = default {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.policy_file = policy.yaml {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] privsep_osbrick.group = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] privsep_osbrick.helper_command = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] privsep_osbrick.user = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_sys_admin.group = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_sys_admin.helper_command = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] cinder_sys_admin.user = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.auth_section = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.auth_type = password {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.cafile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.certfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.collect_timing = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.insecure = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.keyfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.send_service_user_token = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.split_loggers = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] service_user.timeout = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.auth_section = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.auth_type = password {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.certfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.collect_timing = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.insecure = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.keyfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.region_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.split_loggers = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] glance.timeout = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.backend_availability_zone = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.chap_password = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.chap_username = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.disk_geometry = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.driver_client_cert = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.driver_client_cert_key = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.driver_data_namespace = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.driver_use_ssl = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.extra_capabilities = {} {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.filter_function = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.goodness_function = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.iscsi_target_flags = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.iscsi_write_cache = on {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.iser_helper = tgtadm {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.iser_port = 3260 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_host = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_login = admin {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_mount_options = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_password = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_private_key = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_share_path = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.num_shell_tries = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.quobyte_volume_url = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.replication_device = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.report_discard_supported = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.reserved_percentage = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.target_helper = tgtadm {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.target_port = 3260 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.target_protocol = iscsi {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.trace_flags = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.unique_fqdn_network = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.use_chap_auth = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volume_backend_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volume_clear = zero {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volume_clear_ionice = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volume_clear_size = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_reports.file_event_handler = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_reports.log_dir = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.backend_availability_zone = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.backend_host = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.chap_password = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.chap_username = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.chiscsi_conf = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.disk_geometry = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.driver_client_cert = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.driver_data_namespace = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.driver_use_ssl = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.extra_capabilities = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.filter_function = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.goodness_function = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.iser_helper = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.iser_ip_address = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.iser_port = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.iser_target_prefix = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_host = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_login = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_mount_options = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_password = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_private_key = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack quobyte-client[83541]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 22:20:39 devstack quobyte-client[83541]: Invalid parameters found, error: missing mount point. Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_share_path = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack quobyte-client[83541]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_ssh_port = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack quobyte-client[83541]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.num_shell_tries = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.nvmet_port_id = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.replication_device = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.report_discard_supported = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.reserved_percentage = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.scst_target_driver = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.storage_protocol = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.target_helper = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.target_ip_address = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.target_port = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.target_prefix = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.target_protocol = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.trace_flags = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.use_chap_auth = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volume_clear = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volume_clear_size = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] QuobyteHD.volumes_dir = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.ssl = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_notifications.driver = [] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_notifications.retry = -1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] key_manager.fixed_key = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.barbican_api_version = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.barbican_endpoint = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.barbican_endpoint_type = public {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.barbican_region_name = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.cafile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.certfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.collect_timing = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.insecure = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.keyfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.number_of_retries = 60 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.retry_delay = 1 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.send_service_user_token = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.split_loggers = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.timeout = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.verify_ssl = True {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican.verify_ssl_path = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.auth_section = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.auth_type = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.cafile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.certfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.collect_timing = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.insecure = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.keyfile = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.split_loggers = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] barbican_service_user.timeout = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.approle_role_id = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.approle_secret_id = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.kv_mountpoint = secret {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.kv_path = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.kv_version = 2 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.namespace = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.root_token_id = **** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.ssl_ca_crt_file = None {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.timeout = 60.0 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.use_ssl = False {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 22:20:39 devstack cinder-volume[83376]: DEBUG oslo_service.backend._eventlet.service [None req-bfe4cf00-8ae4-4fb4-9362-eca1e6fbbab4 None None] ******************************************************************************** {{(pid=83376) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 22:20:39 devstack sudo[83549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:20:39 devstack sudo[83549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:39 devstack sudo[83549]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.453s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:39 devstack cinder-volume[83540]: INFO cinder.volume.driver [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Driver hasn't implemented _init_vendor_properties() Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.volume.driver [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5844268798828, 'free_capacity_gb': 1775.5844268798828, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83540) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_db.sqlalchemy.engines [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writer thread running {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.db.sqlalchemy.api [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Building query based on filter {{(pid=83540) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83540) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Creating thread for {{(pid=83540) _add_to_threadpool /opt/stack/cinder/cinder/manager.py:166}} Feb 27 22:20:39 devstack cinder-volume[83540]: INFO cinder.keymgr.migration [None req-cd6fb2ea-069b-4e0d-9dfc-53205343933d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:20:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:39 devstack sudo[83586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:20:39 devstack sudo[83586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:40 devstack sudo[83586]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.399s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:20:40 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Driver initialization completed successfully. Feb 27 22:20:40 devstack cinder-volume[83540]: INFO cinder.manager [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Initiating service 3 cleanup Feb 27 22:20:40 devstack cinder-volume[83540]: INFO cinder.manager [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Service 3 cleanup completed. Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG cinder.service [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Creating RPC server for service cinder-volume {{(pid=83540) start /opt/stack/cinder/cinder/service.py:230}} Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG cinder.service [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83540) start /opt/stack/cinder/cinder/service.py:236}} Feb 27 22:20:40 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:20:40 devstack sudo[83598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:20:40 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:20:40 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root Feb 27 22:20:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.400s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:20:40 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6300d3fe-da16-416b-be4a-8e49649f947b None None] Driver post RPC initialization completed successfully. Feb 27 22:20:49 devstack cinder-volume[83376]: DEBUG dbcounter [-] [83376] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83376) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:20:50 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=2 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:20:50 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Flow 'volume_create_manager' (56f4eceb-c800-4384-bd09-9e1aa72d3cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0f4511-5a93-4233-ae15-6f7522340d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0f4511-5a93-4233-ae15-6f7522340d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-618360656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a26bc3e-92ac-4de2-89e4-6bf364743846,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08718ba36a764e38919d7b70ede73055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:38Z,use_quota=True,user_id='401da20a13c44be28ec2e25a058a0261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3006c459-a863-44a9-9618-9002bc1efc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3006c459-a863-44a9-9618-9002bc1efc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60786966-6e18-4c7c-8c66-666ac48971ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60786966-6e18-4c7c-8c66-666ac48971ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a26bc3e-92ac-4de2-89e4-6bf364743846', 'volume_name': 'volume-5a26bc3e-92ac-4de2-89e4-6bf364743846', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad7641e-2f70-4ef2-a51c-3d98bb79c571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad7641e-2f70-4ef2-a51c-3d98bb79c571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8ab932-4596-4618-8928-81ab019e0ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:38 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Volume 5a26bc3e-92ac-4de2-89e4-6bf364743846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a26bc3e-92ac-4de2-89e4-6bf364743846', 'volume_size': 1} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-618360656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a26bc3e-92ac-4de2-89e4-6bf364743846,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08718ba36a764e38919d7b70ede73055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:38Z,use_quota=True,user_id='401da20a13c44be28ec2e25a058a0261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Creating volume 5a26bc3e-92ac-4de2-89e4-6bf364743846 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:21:38 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:21:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:38 devstack sudo[84044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 1073741824 Feb 27 22:21:38 devstack sudo[84044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:40 devstack sudo[84044]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 1073741824" returned: 0 in 1.884s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Flow 'volume_create_manager' (55c42064-761e-489a-877a-14fef9e8b040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62abd7a0-414d-4b1c-846c-368ea4eefb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62abd7a0-414d-4b1c-846c-368ea4eefb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-452967426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3676b9-d19b-4a43-b852-24f922ae82ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e36e2eb5d4049c9b1cad6d1278957fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:40Z,use_quota=True,user_id='adcfb6e046134c9eae6ea5423cef0bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15eac59f-d86e-406a-8caf-47676179b92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15eac59f-d86e-406a-8caf-47676179b92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7ffea6-3fb5-4584-b0dc-3fd92c3700c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7ffea6-3fb5-4584-b0dc-3fd92c3700c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3676b9-d19b-4a43-b852-24f922ae82ff', 'volume_name': 'volume-7f3676b9-d19b-4a43-b852-24f922ae82ff', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908bd320-1956-4646-a235-242916b0237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908bd320-1956-4646-a235-242916b0237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8770a7b6-1379-4907-bfeb-998b0fbab0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:40 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Volume 7f3676b9-d19b-4a43-b852-24f922ae82ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3676b9-d19b-4a43-b852-24f922ae82ff', 'volume_size': 1} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:40 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 Feb 27 22:21:40 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:40 devstack sudo[84367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:21:40 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:41 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846" returned: 0 in 1.143s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] <== create_volume: return (3292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.294s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-452967426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3676b9-d19b-4a43-b852-24f922ae82ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e36e2eb5d4049c9b1cad6d1278957fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:40Z,use_quota=True,user_id='adcfb6e046134c9eae6ea5423cef0bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Creating volume 7f3676b9-d19b-4a43-b852-24f922ae82ff {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:21:41 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:41 devstack sudo[84370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff 1073741824 Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8ab932-4596-4618-8928-81ab019e0ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a26bc3e-92ac-4de2-89e4-6bf364743846', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:41 devstack sudo[84370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9194bb74-ca9c-4f8c-bde5-26e1ca094dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:41 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Volume volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 (5a26bc3e-92ac-4de2-89e4-6bf364743846): created successfully Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9194bb74-ca9c-4f8c-bde5-26e1ca094dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Flow 'volume_create_manager' (56f4eceb-c800-4384-bd09-9e1aa72d3cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:41 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-945bd70a-a3ea-459d-bbf4-e8029404b158 tempest-VolumesTestJSON-464616368 None] Created volume successfully. Feb 27 22:21:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.760s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:42 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:21:42 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:42 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:21:42 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:21:42 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:21:42 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:21:42 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:21:42 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:21:42 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:21:43 devstack sudo[84370]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff 1073741824" returned: 0 in 2.088s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:43 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff Feb 27 22:21:43 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Flow 'volume_create_manager' (4b93fb81-59f7-41ab-8b6e-9b891e1c1569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9daab0c-dd5d-4507-9e0e-68880f384d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9daab0c-dd5d-4507-9e0e-68880f384d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1389733898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d57801-a776-46d2-a534-071fecfb3dbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08718ba36a764e38919d7b70ede73055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:44Z,use_quota=True,user_id='401da20a13c44be28ec2e25a058a0261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912e2357-4ae4-4e62-8038-845c2a4041e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912e2357-4ae4-4e62-8038-845c2a4041e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3e468e-8fd4-4055-8f3a-bf7087f4b0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3e468e-8fd4-4055-8f3a-bf7087f4b0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d57801-a776-46d2-a534-071fecfb3dbb', 'volume_name': 'volume-d9d57801-a776-46d2-a534-071fecfb3dbb', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cd52b7-f804-4a17-b393-783755b73391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cd52b7-f804-4a17-b393-783755b73391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ce5d2b-fd0b-4005-bf2e-d130c74547ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Volume d9d57801-a776-46d2-a534-071fecfb3dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d57801-a776-46d2-a534-071fecfb3dbb', 'volume_size': 1} Feb 27 22:21:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:45 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff" returned: 0 in 1.256s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] <== create_volume: return (3450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.452s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1389733898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d57801-a776-46d2-a534-071fecfb3dbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08718ba36a764e38919d7b70ede73055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:44Z,use_quota=True,user_id='401da20a13c44be28ec2e25a058a0261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Creating volume d9d57801-a776-46d2-a534-071fecfb3dbb {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:21:45 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8770a7b6-1379-4907-bfeb-998b0fbab0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3676b9-d19b-4a43-b852-24f922ae82ff', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07364349-f96b-46f1-bb99-a108da928e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:45 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb 1073741824 Feb 27 22:21:45 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:45 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Volume volume-7f3676b9-d19b-4a43-b852-24f922ae82ff (7f3676b9-d19b-4a43-b852-24f922ae82ff): created successfully Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07364349-f96b-46f1-bb99-a108da928e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Flow 'volume_create_manager' (55c42064-761e-489a-877a-14fef9e8b040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:45 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-280f6285-9a6c-40f5-b7e8-be69eaf2aab6 tempest-ServerRescueNegativeTestJSON-281292068 None] Created volume successfully. Feb 27 22:21:46 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb 1073741824" returned: 0 in 1.580s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:46 devstack sudo[84430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb Feb 27 22:21:46 devstack sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:47 devstack sudo[84430]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb" returned: 0 in 0.969s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] <== create_volume: return (2591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:21:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ce5d2b-fd0b-4005-bf2e-d130c74547ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d57801-a776-46d2-a534-071fecfb3dbb', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76074dfe-5474-4026-9224-63055361c10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:47 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Volume volume-d9d57801-a776-46d2-a534-071fecfb3dbb (d9d57801-a776-46d2-a534-071fecfb3dbb): created successfully Feb 27 22:21:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76074dfe-5474-4026-9224-63055361c10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Flow 'volume_create_manager' (4b93fb81-59f7-41ab-8b6e-9b891e1c1569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:47 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f6b04023-2d92-4ff1-9bc5-80e406cd0d75 tempest-VolumesTestJSON-464616368 None] Created volume successfully. Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Flow 'volume_create_manager' (3f5cee3f-95e8-41c9-b98b-e5e8cf92d588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294c59d9-c7a7-485f-86d1-4c183419e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294c59d9-c7a7-485f-86d1-4c183419e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-97847769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab790e6-de62-422d-80b6-febb16ed1837,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08718ba36a764e38919d7b70ede73055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:49Z,use_quota=True,user_id='401da20a13c44be28ec2e25a058a0261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab05e6f-e16a-488d-a0c7-8a99dea6b9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab05e6f-e16a-488d-a0c7-8a99dea6b9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8227bcd5-2ab8-429c-98b0-dec246c72afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8227bcd5-2ab8-429c-98b0-dec246c72afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab790e6-de62-422d-80b6-febb16ed1837', 'volume_name': 'volume-4ab790e6-de62-422d-80b6-febb16ed1837', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ea3afd-7de1-4d50-9450-a1904fdf080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ea3afd-7de1-4d50-9450-a1904fdf080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ad0a33-13cc-4013-8e21-87ab2916f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:49 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Volume 4ab790e6-de62-422d-80b6-febb16ed1837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab790e6-de62-422d-80b6-febb16ed1837', 'volume_size': 1} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-97847769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab790e6-de62-422d-80b6-febb16ed1837,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08718ba36a764e38919d7b70ede73055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:49Z,use_quota=True,user_id='401da20a13c44be28ec2e25a058a0261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Creating volume 4ab790e6-de62-422d-80b6-febb16ed1837 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:21:49 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:21:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:49 devstack sudo[84435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 1073741824 Feb 27 22:21:49 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:51 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 1073741824" returned: 0 in 1.964s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Flow 'volume_create_manager' (0f80b3c8-4349-4f5d-b248-50689c74aa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f067a641-44c9-40df-b804-e24ca3a91ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f067a641-44c9-40df-b804-e24ca3a91ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:21:51Z,deleted=False,deleted_at=None,display_description='',display_name='0c58d453-4927-4d47-bd70-9e5e0ab497a3-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e53c38-b84e-47ee-8f97-119422c7b22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313dfaab0e04756876a3444935370cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:51Z,use_quota=True,user_id='6b9b19698a3740b6bc2a328c2aefe276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a63b0be-c30e-4404-ac8e-b4fdfc44b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a63b0be-c30e-4404-ac8e-b4fdfc44b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f347b4b9-4c3f-4672-880a-956bdcc94bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f347b4b9-4c3f-4672-880a-956bdcc94bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e53c38-b84e-47ee-8f97-119422c7b22a', 'volume_name': 'volume-45e53c38-b84e-47ee-8f97-119422c7b22a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1990606-1ca5-4593-abf1-b9d94a53d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1990606-1ca5-4593-abf1-b9d94a53d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a52fd99-41e4-4912-a1d3-a021a5affa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:51 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Volume 45e53c38-b84e-47ee-8f97-119422c7b22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e53c38-b84e-47ee-8f97-119422c7b22a', 'volume_size': 1} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:51 devstack sudo[84464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 Feb 27 22:21:51 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:52 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837" returned: 0 in 0.811s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] <== create_volume: return (2878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.887s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.832s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:21:51Z,deleted=False,deleted_at=None,display_description='',display_name='0c58d453-4927-4d47-bd70-9e5e0ab497a3-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e53c38-b84e-47ee-8f97-119422c7b22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313dfaab0e04756876a3444935370cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:21:51Z,use_quota=True,user_id='6b9b19698a3740b6bc2a328c2aefe276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Creating volume 45e53c38-b84e-47ee-8f97-119422c7b22a {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:21:52 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ad0a33-13cc-4013-8e21-87ab2916f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab790e6-de62-422d-80b6-febb16ed1837', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afec936-6106-44b9-b5ac-9e876cf0b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:52 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Volume volume-4ab790e6-de62-422d-80b6-febb16ed1837 (4ab790e6-de62-422d-80b6-febb16ed1837): created successfully Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afec936-6106-44b9-b5ac-9e876cf0b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:52 devstack sudo[84474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a 1073741824 Feb 27 22:21:52 devstack sudo[84474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Flow 'volume_create_manager' (3f5cee3f-95e8-41c9-b98b-e5e8cf92d588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:52 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5abc3c43-d2e7-416b-80b1-0d62e60cdc75 tempest-VolumesTestJSON-464616368 None] Created volume successfully. Feb 27 22:21:53 devstack sudo[84474]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a 1073741824" returned: 0 in 1.318s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:53 devstack sudo[84480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a Feb 27 22:21:53 devstack sudo[84480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:54 devstack sudo[84480]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a" returned: 0 in 1.296s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:21:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] <== create_volume: return (2719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:21:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.725s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:21:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a52fd99-41e4-4912-a1d3-a021a5affa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e53c38-b84e-47ee-8f97-119422c7b22a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f30bfb-d3f6-4f6b-9e92-e38d009a2c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:21:55 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Volume volume-45e53c38-b84e-47ee-8f97-119422c7b22a (45e53c38-b84e-47ee-8f97-119422c7b22a): created successfully Feb 27 22:21:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f30bfb-d3f6-4f6b-9e92-e38d009a2c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:21:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Flow 'volume_create_manager' (0f80b3c8-4349-4f5d-b248-50689c74aa83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:21:55 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-1bce734b-0a51-4bc6-8d2b-df48a9ea5f23 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Created volume successfully. Feb 27 22:21:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Acquiring lock "cinder-4ab790e6-de62-422d-80b6-febb16ed1837-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:21:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Lock "cinder-4ab790e6-de62-422d-80b6-febb16ed1837-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:21:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Acquiring lock "cinder-quobyte-4ab790e6-de62-422d-80b6-febb16ed1837" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:21:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Lock "cinder-quobyte-4ab790e6-de62-422d-80b6-febb16ed1837" acquired by "delete_volume" :: waited 0.064s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:21:55 devstack cinder-volume[83540]: INFO oslo.privsep.daemon [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0joviuhq/privsep.sock'] Feb 27 22:21:55 devstack sudo[84507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0joviuhq/privsep.sock Feb 27 22:21:55 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:21:59 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root Feb 27 22:21:59 devstack cinder-volume[83540]: INFO oslo.privsep.daemon [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Spawned new privsep daemon via rootwrap Feb 27 22:21:59 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Accepted privsep connection to /tmp/tmp0joviuhq/privsep.sock {{(pid=83540) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 27 22:21:59 devstack cinder-volume[83540]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 27 22:21:59 devstack cinder-volume[83540]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 27 22:21:59 devstack cinder-volume[83540]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 27 22:21:59 devstack cinder-volume[83540]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84523 Feb 27 22:21:59 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2dab30-a137-4425-9926-21818c81fa39]: (2,) {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:21:59 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c77f45-5dc7-4d92-bf0b-b679cdb12667]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:21:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:21:59 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 Feb 27 22:21:59 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:00 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837" returned: 0 in 0.984s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:00 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837 Feb 27 22:22:00 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:01 devstack cinder-volume[83540]: WARNING py.warnings [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-f64f2d88-a8cc-4215-875c-8ea2930fa005 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Feb 27 22:22:01 devstack cinder-volume[83540]: .first() Feb 27 22:22:01 devstack cinder-volume[83540]: Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-f64f2d88-a8cc-4215-875c-8ea2930fa005 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-f64f2d88-a8cc-4215-875c-8ea2930fa005 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[202f50a3-da3a-4e73-82fd-7ff5a28a7941]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-f64f2d88-a8cc-4215-875c-8ea2930fa005 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:01 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4ab790e6-de62-422d-80b6-febb16ed1837" returned: 0 in 1.141s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Lock "cinder-quobyte-4ab790e6-de62-422d-80b6-febb16ed1837" released by "delete_volume" :: held 5.824s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:01 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a Feb 27 22:22:01 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:01 devstack cinder-volume[83540]: WARNING cinder.quota [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:22:01 devstack cinder-volume[83540]: WARNING cinder.quota [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Created reservations ['4d71c584-0136-4d07-835d-468caad4f43c', '82d5f0c0-b991-463a-973a-1ffd689b0ed6', '68556a06-22f7-4366-ae7c-7cc03cfd70c8', '88acfd0a-5168-4aea-9706-9e9ec8490901'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:01 devstack sudo[84597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:01 devstack sudo[84597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Acquiring lock "cinder-d9d57801-a776-46d2-a534-071fecfb3dbb-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Lock "cinder-d9d57801-a776-46d2-a534-071fecfb3dbb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Acquiring lock "cinder-quobyte-d9d57801-a776-46d2-a534-071fecfb3dbb" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Lock "cinder-quobyte-d9d57801-a776-46d2-a534-071fecfb3dbb" acquired by "delete_volume" :: waited 0.040s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:02 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b60de3-4387-4ee1-839c-037834fe418e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:22:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:03 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-f64f2d88-a8cc-4215-875c-8ea2930fa005 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a" returned: 0 in 1.871s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-f64f2d88-a8cc-4215-875c-8ea2930fa005 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.916s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:03 devstack sudo[84627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb Feb 27 22:22:03 devstack sudo[84627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-f64f2d88-a8cc-4215-875c-8ea2930fa005 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6', 'name': 'volume-45e53c38-b84e-47ee-8f97-119422c7b22a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e4d704f-8fa8-4d67-a979-b1996e9dcb83', 'enforce_multipath': True} {{(pid=83540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4927}} Feb 27 22:22:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-c4601538-a684-4b13-a3e5-57a3802d3240 req-f64f2d88-a8cc-4215-875c-8ea2930fa005 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] attachment_update completed successfully. Feb 27 22:22:03 devstack sudo[84597]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 2.120s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:03 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Deleted volume successfully. Feb 27 22:22:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3e6aa984-10bf-4fdb-85a0-730b375cc73a tempest-VolumesTestJSON-464616368 None] Lock "cinder-4ab790e6-de62-422d-80b6-febb16ed1837-delete_volume" released by "delete_volume" :: held 8.571s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:04 devstack sudo[84627]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb" returned: 0 in 1.850s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:04 devstack sudo[84636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb Feb 27 22:22:04 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Acquiring lock "cinder-7f3676b9-d19b-4a43-b852-24f922ae82ff-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "cinder-7f3676b9-d19b-4a43-b852-24f922ae82ff-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Acquiring lock "cinder-quobyte-7f3676b9-d19b-4a43-b852-24f922ae82ff" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "cinder-quobyte-7f3676b9-d19b-4a43-b852-24f922ae82ff" acquired by "delete_volume" :: waited 0.026s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[767776c9-06df-44f3-8f6f-104830cfadd3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:05 devstack sudo[84640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff Feb 27 22:22:05 devstack sudo[84640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:05 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d9d57801-a776-46d2-a534-071fecfb3dbb" returned: 0 in 1.240s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Lock "cinder-quobyte-d9d57801-a776-46d2-a534-071fecfb3dbb" released by "delete_volume" :: held 3.215s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Created reservations ['19113653-809e-4a2c-96e9-f62a25b49258', 'a00595cb-6506-42ea-9a89-9879a494d109', '19056ae2-550c-40b1-aa42-51807de262fc', '75c93a73-dbc5-46a5-abc9-f8e3f321c49a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:05 devstack sudo[84642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:05 devstack sudo[84642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:06 devstack sudo[84642]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.883s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:06 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:06 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Deleted volume successfully. Feb 27 22:22:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb2fe70a-7a1e-40b8-bfab-5138dc2c5143 tempest-VolumesTestJSON-464616368 None] Lock "cinder-d9d57801-a776-46d2-a534-071fecfb3dbb-delete_volume" released by "delete_volume" :: held 4.528s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Acquiring lock "cinder-5a26bc3e-92ac-4de2-89e4-6bf364743846-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Lock "cinder-5a26bc3e-92ac-4de2-89e4-6bf364743846-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Acquiring lock "cinder-quobyte-5a26bc3e-92ac-4de2-89e4-6bf364743846" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Lock "cinder-quobyte-5a26bc3e-92ac-4de2-89e4-6bf364743846" acquired by "delete_volume" :: waited 0.021s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:07 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50bb3f9-6252-48f6-a62b-139d03c287fb]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:22:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:07 devstack sudo[84640]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff" returned: 0 in 1.839s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:07 devstack sudo[84718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff Feb 27 22:22:07 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:07 devstack sudo[84717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 Feb 27 22:22:07 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:08 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846" returned: 0 in 1.134s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:08 devstack sudo[84728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846 Feb 27 22:22:08 devstack sudo[84728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:08 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f3676b9-d19b-4a43-b852-24f922ae82ff" returned: 0 in 1.232s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "cinder-quobyte-7f3676b9-d19b-4a43-b852-24f922ae82ff" released by "delete_volume" :: held 3.185s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Created reservations ['90ba298a-983d-4f19-965c-f3243a75c8f0', '84cd2a05-d396-4973-a89d-f0d2c1dcf710', '499a663a-c439-4d71-9e52-ad85a439a4cf', 'b2e18c68-4443-42c9-8673-dbea8f459a04'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:08 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:08 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:09 devstack sudo[84728]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a26bc3e-92ac-4de2-89e4-6bf364743846" returned: 0 in 1.482s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Lock "cinder-quobyte-5a26bc3e-92ac-4de2-89e4-6bf364743846" released by "delete_volume" :: held 2.737s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Created reservations ['77e94f86-b0ca-462e-9f27-af085cd84904', 'b339d300-0318-416c-b5e4-da9d537cc71e', '25ed0931-72f4-456f-babd-7d513417ae67', '4a52e974-372e-4520-8c3e-4e4408603a63'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:10 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.338s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:10 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Deleted volume successfully. Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fca6ac85-41c7-4676-a4cc-690f5c101c17 tempest-ServerRescueNegativeTestJSON-281292068 None] Lock "cinder-7f3676b9-d19b-4a43-b852-24f922ae82ff-delete_volume" released by "delete_volume" :: held 5.040s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:10 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:10 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:11 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.518s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:11 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Deleted volume successfully. Feb 27 22:22:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7431a7e6-61b1-4f46-b202-856fc621cec4 tempest-VolumesTestJSON-464616368 None] Lock "cinder-5a26bc3e-92ac-4de2-89e4-6bf364743846-delete_volume" released by "delete_volume" :: held 4.757s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:19 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-925cb25c-254b-4116-96ff-c5dc0b5cdb6e tempest-GroupsTest-743330691 None] Group tempest-Group1-1468375614: creating Feb 27 22:22:19 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-925cb25c-254b-4116-96ff-c5dc0b5cdb6e tempest-GroupsTest-743330691 None] Group tempest-Group1-1468375614: created successfully Feb 27 22:22:19 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-925cb25c-254b-4116-96ff-c5dc0b5cdb6e tempest-GroupsTest-743330691 None] Create group completed successfully. Feb 27 22:22:20 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e24ecef0-590b-40f0-91e3-44a0cf1e8255 tempest-GroupsTest-743330691 None] Group tempest-Group2-81819614: creating Feb 27 22:22:20 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e24ecef0-590b-40f0-91e3-44a0cf1e8255 tempest-GroupsTest-743330691 None] Group tempest-Group2-81819614: created successfully Feb 27 22:22:20 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e24ecef0-590b-40f0-91e3-44a0cf1e8255 tempest-GroupsTest-743330691 None] Create group completed successfully. Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Flow 'volume_create_manager' (6cf2e41a-de8a-440b-9837-4ae65b62105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4b4b73-da0e-40d0-89ed-c9f2b0127571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4b4b73-da0e-40d0-89ed-c9f2b0127571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876785358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=745a967e-eca9-41fc-a0da-9b1b6c2ff3fc,host='devstack@QuobyteHD#QuobyteHD',id=f3c3c0a4-781d-4f58-a293-511e8f1393f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8adc178c354488815ad3acafda88c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:22:22Z,use_quota=True,user_id='c09ef109cbf741a08fda8346afbb2840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57742a76-1539-47c5-9d7d-55beaa2bf421),volume_type_id=57742a76-1539-47c5-9d7d-55beaa2bf421)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f5f49c-d3d3-481a-818d-0508330d6628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f5f49c-d3d3-481a-818d-0508330d6628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2fcdd1-0fb3-4d81-aace-54ef44a5c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2fcdd1-0fb3-4d81-aace-54ef44a5c964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c3c0a4-781d-4f58-a293-511e8f1393f5', 'volume_name': 'volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6096a012-b2cf-4545-91ba-3816ba7215eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6096a012-b2cf-4545-91ba-3816ba7215eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb9f228-552e-4f77-8aed-7e3f9bd3a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:21 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Volume f3c3c0a4-781d-4f58-a293-511e8f1393f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5', 'volume_size': 1} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=745a967e-eca9-41fc-a0da-9b1b6c2ff3fc,created_at=2026-02-27T21:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876785358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=745a967e-eca9-41fc-a0da-9b1b6c2ff3fc,host='devstack@QuobyteHD#QuobyteHD',id=f3c3c0a4-781d-4f58-a293-511e8f1393f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8adc178c354488815ad3acafda88c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:22:22Z,use_quota=True,user_id='c09ef109cbf741a08fda8346afbb2840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57742a76-1539-47c5-9d7d-55beaa2bf421),volume_type_id=57742a76-1539-47c5-9d7d-55beaa2bf421)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Creating volume f3c3c0a4-781d-4f58-a293-511e8f1393f5 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:22:21 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:22:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:22 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 1073741824 Feb 27 22:22:22 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:22 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 1073741824" returned: 0 in 0.723s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:22 devstack sudo[85153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 Feb 27 22:22:22 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:23 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5" returned: 0 in 0.744s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:22:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb9f228-552e-4f77-8aed-7e3f9bd3a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9609f413-b5b4-4d97-ac2a-c4133e531919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:23 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Volume volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 (f3c3c0a4-781d-4f58-a293-511e8f1393f5): created successfully Feb 27 22:22:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9609f413-b5b4-4d97-ac2a-c4133e531919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Flow 'volume_create_manager' (6cf2e41a-de8a-440b-9837-4ae65b62105f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:22:23 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c72fc46f-a726-4a41-91f0-127e62217538 tempest-GroupsTest-743330691 None] Created volume successfully. Feb 27 22:22:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Acquiring lock "cinder-quobyte-f3c3c0a4-781d-4f58-a293-511e8f1393f5" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Lock "cinder-quobyte-f3c3c0a4-781d-4f58-a293-511e8f1393f5" acquired by "delete_volume" :: waited 0.018s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:24 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aa6e23-3c1b-4b38-8791-c592f44d10c5]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:22:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:25 devstack sudo[85176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 Feb 27 22:22:25 devstack sudo[85176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:25 devstack sudo[85176]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5" returned: 0 in 0.994s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:25 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5 Feb 27 22:22:25 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:26 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f3c3c0a4-781d-4f58-a293-511e8f1393f5" returned: 0 in 0.565s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Lock "cinder-quobyte-f3c3c0a4-781d-4f58-a293-511e8f1393f5" released by "delete_volume" :: held 1.606s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Created reservations ['89632309-6c8c-4cb2-a628-3bc969462640'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:26 devstack cinder-volume[83540]: WARNING cinder.quota [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-127386953 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-127386953, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:22:26 devstack cinder-volume[83540]: WARNING cinder.quota [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-127386953 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-127386953, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Created reservations ['8d0d9d22-baee-46f7-beae-62fc716e450a', 'e4b3c73c-c865-4679-9480-ca18f31f0505', '8bbd784c-73aa-4afb-8482-9926d54546c2', 'a36f82f6-19c8-42ce-a635-f0371d58562b'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:26 devstack sudo[85208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:26 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Created reservations ['834a77ef-7e2c-4d7a-83c4-a63e5664ad7a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:27 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.603s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:27 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a365dea8-b9e3-415b-bbfe-85f7bfd33d0f tempest-GroupsTest-743330691 None] Delete group completed successfully. Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:27 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:27 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:28 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.611s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:28 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:28 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7bba2930-e33b-4f7b-8054-7e9bd4ef8b38 tempest-GroupsTest-743330691 None] Delete group completed successfully. Feb 27 22:22:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-eced4817-c0b8-4560-992a-a0088ee560bd tempest-GroupsTest-743330691 None] Group tempest-GroupsTest-Group-477003017: creating Feb 27 22:22:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-eced4817-c0b8-4560-992a-a0088ee560bd tempest-GroupsTest-743330691 None] Group tempest-GroupsTest-Group-477003017: created successfully Feb 27 22:22:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-eced4817-c0b8-4560-992a-a0088ee560bd tempest-GroupsTest-743330691 None] Create group completed successfully. Feb 27 22:22:30 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=68,cinder:UPDATE=67,cinder:DELETE=6,cinder:INSERT=12 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:22:30 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=69,cinder:SELECT=46,cinder:INSERT=16,cinder:DELETE=4 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:22:30 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:22:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Flow 'volume_create_manager' (2541fb58-c3e3-44d3-83c8-306c0aa15671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:22:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03a8e5b-1e4f-4e65-9762-22f579af9fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03a8e5b-1e4f-4e65-9762-22f579af9fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-718593096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bafb70fd-d376-4b66-b861-87c27996b738,host='devstack@QuobyteHD#QuobyteHD',id=ac977c2a-9254-4044-b5ba-a6c4964405d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8adc178c354488815ad3acafda88c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:22:31Z,use_quota=True,user_id='c09ef109cbf741a08fda8346afbb2840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8155cc6b-cbb6-423a-a213-411aa0402cf1),volume_type_id=8155cc6b-cbb6-423a-a213-411aa0402cf1)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d675e2-7b7a-4eb6-bd13-935c7096c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d675e2-7b7a-4eb6-bd13-935c7096c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad5bfe2-c360-4069-9f0a-8f8da9e65757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad5bfe2-c360-4069-9f0a-8f8da9e65757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac977c2a-9254-4044-b5ba-a6c4964405d9', 'volume_name': 'volume-ac977c2a-9254-4044-b5ba-a6c4964405d9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f913c5-06bf-4c13-8373-aa94d5912f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f913c5-06bf-4c13-8373-aa94d5912f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a214b57e-edf7-47a3-b820-b81c75ab6286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:31 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Volume ac977c2a-9254-4044-b5ba-a6c4964405d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac977c2a-9254-4044-b5ba-a6c4964405d9', 'volume_size': 1} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bafb70fd-d376-4b66-b861-87c27996b738,created_at=2026-02-27T21:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-718593096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bafb70fd-d376-4b66-b861-87c27996b738,host='devstack@QuobyteHD#QuobyteHD',id=ac977c2a-9254-4044-b5ba-a6c4964405d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8adc178c354488815ad3acafda88c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:22:31Z,use_quota=True,user_id='c09ef109cbf741a08fda8346afbb2840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8155cc6b-cbb6-423a-a213-411aa0402cf1),volume_type_id=8155cc6b-cbb6-423a-a213-411aa0402cf1)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Creating volume ac977c2a-9254-4044-b5ba-a6c4964405d9 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:22:31 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:22:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:31 devstack sudo[85243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 1073741824 Feb 27 22:22:31 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:32 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 1073741824" returned: 0 in 1.003s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:32 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 Feb 27 22:22:32 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:32 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9" returned: 0 in 0.776s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:22:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a214b57e-edf7-47a3-b820-b81c75ab6286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac977c2a-9254-4044-b5ba-a6c4964405d9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a197c-2e3e-4f9d-9a70-18cb4be78c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:33 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Volume volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 (ac977c2a-9254-4044-b5ba-a6c4964405d9): created successfully Feb 27 22:22:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a197c-2e3e-4f9d-9a70-18cb4be78c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Flow 'volume_create_manager' (2541fb58-c3e3-44d3-83c8-306c0aa15671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:22:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a7476924-4c05-4084-9964-0a33cc7da596 tempest-GroupsTest-743330691 None] Created volume successfully. Feb 27 22:22:33 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:22:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Flow 'volume_create_manager' (a005bc09-b45b-4de7-963f-44616067082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:22:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba0211e-fd6d-4cc4-ab0b-64b278972f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba0211e-fd6d-4cc4-ab0b-64b278972f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152219584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bafb70fd-d376-4b66-b861-87c27996b738,host='devstack@QuobyteHD#QuobyteHD',id=e9b4b42e-df93-452c-ae28-8c1906a03d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8adc178c354488815ad3acafda88c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:22:34Z,use_quota=True,user_id='c09ef109cbf741a08fda8346afbb2840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8155cc6b-cbb6-423a-a213-411aa0402cf1),volume_type_id=8155cc6b-cbb6-423a-a213-411aa0402cf1)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d80869-5de9-4207-bcdf-9b3167ff1979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d80869-5de9-4207-bcdf-9b3167ff1979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e844ee50-9bf2-41f1-a749-54384cec5808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e844ee50-9bf2-41f1-a749-54384cec5808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b4b42e-df93-452c-ae28-8c1906a03d3e', 'volume_name': 'volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d536fbb9-5be6-4967-825a-817efa3dcb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d536fbb9-5be6-4967-825a-817efa3dcb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd5d440-83a6-4584-afd0-e3f6e77d97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:34 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Volume e9b4b42e-df93-452c-ae28-8c1906a03d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e', 'volume_size': 1} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bafb70fd-d376-4b66-b861-87c27996b738,created_at=2026-02-27T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152219584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bafb70fd-d376-4b66-b861-87c27996b738,host='devstack@QuobyteHD#QuobyteHD',id=e9b4b42e-df93-452c-ae28-8c1906a03d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8adc178c354488815ad3acafda88c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:22:34Z,use_quota=True,user_id='c09ef109cbf741a08fda8346afbb2840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8155cc6b-cbb6-423a-a213-411aa0402cf1),volume_type_id=8155cc6b-cbb6-423a-a213-411aa0402cf1)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Creating volume e9b4b42e-df93-452c-ae28-8c1906a03d3e {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:22:34 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:22:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:34 devstack sudo[85252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e 1073741824 Feb 27 22:22:34 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:35 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e 1073741824" returned: 0 in 1.004s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:35 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e Feb 27 22:22:35 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:35 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e" returned: 0 in 0.840s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd5d440-83a6-4584-afd0-e3f6e77d97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf97688-f4b6-4bdd-8fd2-ff0468fc7d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:35 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Volume volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e (e9b4b42e-df93-452c-ae28-8c1906a03d3e): created successfully Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf97688-f4b6-4bdd-8fd2-ff0468fc7d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Flow 'volume_create_manager' (a005bc09-b45b-4de7-963f-44616067082c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:22:35 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b0400955-5cc4-471c-80d3-85ec6aa972d8 tempest-GroupsTest-743330691 None] Created volume successfully. Feb 27 22:22:36 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b1ebaf68-12a0-4b2f-9572-61b5524881c5 tempest-GroupsTest-743330691 None] Update group completed successfully. Feb 27 22:22:37 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2bf6c685-a1bf-4ad0-9f5b-9b6983060bcc tempest-GroupsTest-743330691 None] Update group completed successfully. Feb 27 22:22:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Acquiring lock "cinder-quobyte-ac977c2a-9254-4044-b5ba-a6c4964405d9" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Lock "cinder-quobyte-ac977c2a-9254-4044-b5ba-a6c4964405d9" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:39 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfea08a-214c-42b8-8815-0a915a48f8e5]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:22:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:39 devstack sudo[85302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 Feb 27 22:22:39 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:39 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9" returned: 0 in 0.720s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:40 devstack sudo[85308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9 Feb 27 22:22:40 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:40 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ac977c2a-9254-4044-b5ba-a6c4964405d9" returned: 0 in 0.658s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Lock "cinder-quobyte-ac977c2a-9254-4044-b5ba-a6c4964405d9" released by "delete_volume" :: held 1.421s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Acquiring lock "cinder-quobyte-e9b4b42e-df93-452c-ae28-8c1906a03d3e" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Lock "cinder-quobyte-e9b4b42e-df93-452c-ae28-8c1906a03d3e" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b06c22c-ee74-40a9-8723-b7862bd3831c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:40 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e Feb 27 22:22:40 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:40 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:40 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:41 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.629s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:22:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:22:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:22:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:22:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:22:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:22:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:22:41 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e" returned: 0 in 0.947s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:41 devstack sudo[85321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e Feb 27 22:22:41 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:42 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9b4b42e-df93-452c-ae28-8c1906a03d3e" returned: 0 in 0.575s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Lock "cinder-quobyte-e9b4b42e-df93-452c-ae28-8c1906a03d3e" released by "delete_volume" :: held 1.553s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Created reservations ['6742e9a4-0de6-4121-a3ab-76736f248c94'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:42 devstack cinder-volume[83540]: WARNING cinder.quota [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-681888529 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-681888529, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:22:42 devstack cinder-volume[83540]: WARNING cinder.quota [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-681888529 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-681888529, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Created reservations ['1eebffa2-ddf2-49bf-9582-7f39badd2481', '0208dac3-0d80-44be-9b4f-1cbdcaa39f99', '87f5406c-3c8f-43ff-97ed-08073295859d', 'c9225b5a-7a9f-44ba-9b34-d4052dc3f9b4'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Created reservations ['521bf542-68bb-4c8d-968d-dae5c42dab9b', 'f998baad-4f5c-4835-9906-fe732e3ca6d5', '6e0253e1-3810-4e59-b43e-bfbfc991fc8d', '2995eb98-6e62-454e-8c31-51585ac3acab'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:42 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:42 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:43 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.520s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:43 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:43 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c1134e94-bfa0-4a7f-9f11-2f32276e418f tempest-GroupsTest-743330691 None] Delete group completed successfully. Feb 27 22:22:52 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=29,cinder:DELETE=2,cinder:SELECT=20,cinder:INSERT=3 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:22:52 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=8 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Flow 'volume_create_manager' (f3d12017-f1eb-4a4b-975a-851cf6156f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb79b73f-17e3-44ca-a113-d3d2652ee5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb79b73f-17e3-44ca-a113-d3d2652ee5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1796514450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd856202-867d-4467-a69c-137067d9bb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f22f31daf0d495fb932619bfb1d3d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:22:55Z,use_quota=True,user_id='814cc58388a94ad8b4152f53e3cfda42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b81c8a4f-11c3-41fa-896f-51cd21d6170c),volume_type_id=b81c8a4f-11c3-41fa-896f-51cd21d6170c)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd2a434-916f-478d-b387-c50f3459a2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd2a434-916f-478d-b387-c50f3459a2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420a21a7-d82a-44be-a7f8-636c718c75b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420a21a7-d82a-44be-a7f8-636c718c75b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd856202-867d-4467-a69c-137067d9bb73', 'volume_name': 'volume-bd856202-867d-4467-a69c-137067d9bb73', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465377f2-4181-4680-9274-baff20255b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465377f2-4181-4680-9274-baff20255b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2d6d2a-19b1-40cd-ace9-121b43daf0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:54 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Volume bd856202-867d-4467-a69c-137067d9bb73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd856202-867d-4467-a69c-137067d9bb73', 'volume_size': 1} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1796514450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd856202-867d-4467-a69c-137067d9bb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f22f31daf0d495fb932619bfb1d3d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:22:55Z,use_quota=True,user_id='814cc58388a94ad8b4152f53e3cfda42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b81c8a4f-11c3-41fa-896f-51cd21d6170c),volume_type_id=b81c8a4f-11c3-41fa-896f-51cd21d6170c)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Creating volume bd856202-867d-4467-a69c-137067d9bb73 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:22:54 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:22:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:54 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 1073741824 Feb 27 22:22:54 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:55 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 1073741824" returned: 0 in 0.719s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:55 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 Feb 27 22:22:55 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:56 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73" returned: 0 in 0.574s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2d6d2a-19b1-40cd-ace9-121b43daf0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd856202-867d-4467-a69c-137067d9bb73', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d01a615-ca2a-45c1-8381-e85172a93579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:22:56 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Volume volume-bd856202-867d-4467-a69c-137067d9bb73 (bd856202-867d-4467-a69c-137067d9bb73): created successfully Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d01a615-ca2a-45c1-8381-e85172a93579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Flow 'volume_create_manager' (f3d12017-f1eb-4a4b-975a-851cf6156f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:22:56 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-eeb55038-7a64-46a6-adfe-813f037d979e tempest-VolumeTypesAccessTest-2031673524 None] Created volume successfully. Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Acquiring lock "cinder-bd856202-867d-4467-a69c-137067d9bb73-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Lock "cinder-bd856202-867d-4467-a69c-137067d9bb73-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Acquiring lock "cinder-quobyte-bd856202-867d-4467-a69c-137067d9bb73" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:22:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Lock "cinder-quobyte-bd856202-867d-4467-a69c-137067d9bb73" acquired by "delete_volume" :: waited 0.057s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:22:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ee8a6-7523-4295-9c47-9da259e74ecd]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:22:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:57 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 Feb 27 22:22:57 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:57 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73" returned: 0 in 0.655s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:57 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73 Feb 27 22:22:57 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:58 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bd856202-867d-4467-a69c-137067d9bb73" returned: 0 in 0.640s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Lock "cinder-quobyte-bd856202-867d-4467-a69c-137067d9bb73" released by "delete_volume" :: held 1.334s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:22:58 devstack cinder-volume[83540]: WARNING cinder.quota [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1981753569 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1981753569, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:22:58 devstack cinder-volume[83540]: WARNING cinder.quota [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1981753569 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1981753569, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Created reservations ['6eb2c336-08b1-49cf-a033-3a73a880f055', 'b283c78d-74be-4bea-b435-3a8405c7184e', '8ba9e05b-dfdc-4cf3-8be1-fc87df118a2f', 'adad0c05-6e82-4e40-a063-75c1f90bdfcc'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:22:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:22:58 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:22:58 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:22:59 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Feb 27 22:22:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.519s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:22:59 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:22:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Deleted volume successfully. Feb 27 22:22:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-35b08350-2da2-4191-a370-aa2a359cc36b tempest-VolumeTypesAccessTest-2031673524 None] Lock "cinder-bd856202-867d-4467-a69c-137067d9bb73-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:23:08 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:23:09 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Flow 'volume_create_manager' (b8d85ead-dd34-4ff1-a7c9-3468a070d469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f99c8f1-6c3a-4e9f-bb72-f7c86cd1387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f99c8f1-6c3a-4e9f-bb72-f7c86cd1387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-914997660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b14a758-e136-4a4d-8e4b-00071f33f6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211ae66738144b4b5260863254c15d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:23:18Z,use_quota=True,user_id='d9904415bd6442e3916e5b878afa07f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602138ff-406d-47b7-bca9-3867faf85569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602138ff-406d-47b7-bca9-3867faf85569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84957e6c-53de-4b0b-881d-82797187f4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84957e6c-53de-4b0b-881d-82797187f4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b14a758-e136-4a4d-8e4b-00071f33f6c1', 'volume_name': 'volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9931da19-d881-4d91-ad90-3ff2f99c5e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9931da19-d881-4d91-ad90-3ff2f99c5e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7a7029-4853-433b-93ed-f4ffc16b9677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Volume 9b14a758-e136-4a4d-8e4b-00071f33f6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1', 'volume_size': 1} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-914997660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b14a758-e136-4a4d-8e4b-00071f33f6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0211ae66738144b4b5260863254c15d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:23:18Z,use_quota=True,user_id='d9904415bd6442e3916e5b878afa07f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Creating volume 9b14a758-e136-4a4d-8e4b-00071f33f6c1 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:23:17 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:23:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:17 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 1073741824 Feb 27 22:23:17 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:19 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 1073741824" returned: 0 in 1.451s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:19 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 Feb 27 22:23:19 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:20 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1" returned: 0 in 1.334s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] <== create_volume: return (2898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:23:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.901s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:23:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7a7029-4853-433b-93ed-f4ffc16b9677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbabfd9-aaea-4831-a083-693ca49f0a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:20 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Volume volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 (9b14a758-e136-4a4d-8e4b-00071f33f6c1): created successfully Feb 27 22:23:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbabfd9-aaea-4831-a083-693ca49f0a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Flow 'volume_create_manager' (b8d85ead-dd34-4ff1-a7c9-3468a070d469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:23:20 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-63bf2a76-daa9-4642-a8ff-a88c8f07fab5 tempest-VolumesAdminNegativeTest-11862386 None] Created volume successfully. Feb 27 22:23:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Acquiring lock "cinder-9b14a758-e136-4a4d-8e4b-00071f33f6c1-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:23:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Lock "cinder-9b14a758-e136-4a4d-8e4b-00071f33f6c1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:23:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Acquiring lock "cinder-quobyte-9b14a758-e136-4a4d-8e4b-00071f33f6c1" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:23:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Lock "cinder-quobyte-9b14a758-e136-4a4d-8e4b-00071f33f6c1" acquired by "delete_volume" :: waited 0.044s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:23:23 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a1c57-c36a-4fc4-8e9e-3bef9131b8ad]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:23:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:23 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 Feb 27 22:23:23 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:24 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1" returned: 0 in 1.219s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:25 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1 Feb 27 22:23:25 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:26 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-9b14a758-e136-4a4d-8e4b-00071f33f6c1" returned: 0 in 1.657s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Lock "cinder-quobyte-9b14a758-e136-4a4d-8e4b-00071f33f6c1" released by "delete_volume" :: held 3.053s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Created reservations ['e57e0c88-9c89-455a-a340-cdca021546b3', '4c82894b-358c-456d-a09d-3a9e22ecce4a', 'f937d206-47a7-46fc-b7dd-42ffe10ddc56', '5a7482a3-b404-4889-8ace-cc0414069b4b'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:23:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:26 devstack sudo[85646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:23:26 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:28 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.596s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:28 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:23:28 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Deleted volume successfully. Feb 27 22:23:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-145690ff-e9aa-4a52-86f1-e9eb578b744b tempest-VolumesAdminNegativeTest-11862386 None] Lock "cinder-9b14a758-e136-4a4d-8e4b-00071f33f6c1-delete_volume" released by "delete_volume" :: held 5.211s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:23:36 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:23:38 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:23:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:23:40 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:23:40 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:23:40 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:23:40 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:23:40 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:23:40 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:23:42 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:23:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Flow 'volume_create_manager' (b3c9c99e-d841-4210-ba52-a0da63b1036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:23:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b560df54-7cd5-4930-bafe-3588c8af2e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b560df54-7cd5-4930-bafe-3588c8af2e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:23:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b720056c-4b2c-4715-8514-017c4acd9ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313dfaab0e04756876a3444935370cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:23:42Z,use_quota=True,user_id='6b9b19698a3740b6bc2a328c2aefe276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dec09e-7125-4f9d-9346-b0f1463005fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dec09e-7125-4f9d-9346-b0f1463005fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ec363d-d1ff-4451-be60-f1460549854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:42 devstack cinder-volume[83540]: DEBUG cinder.image.glance [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Creating Keystone auth plugin from conf {{(pid=83540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 22:23:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ec363d-d1ff-4451-be60-f1460549854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b720056c-4b2c-4715-8514-017c4acd9ab3', 'volume_name': 'volume-b720056c-4b2c-4715-8514-017c4acd9ab3', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e571255c-1e3b-411a-981d-449fc6a8307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e571255c-1e3b-411a-981d-449fc6a8307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:23:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f24f119-b542-4999-8c69-6f4267b9547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:23:43 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Volume b720056c-4b2c-4715-8514-017c4acd9ab3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b720056c-4b2c-4715-8514-017c4acd9ab3', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 22:23:43 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Trying to clone b720056c-4b2c-4715-8514-017c4acd9ab3 from image b38627d9-9522-4831-a36d-1e8d5b5fd424 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]). {{(pid=83540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 22:23:43 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 22:23:43 devstack cinder-volume[83540]: INFO cinder.image.image_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Image download 20.69 MB at 20.69 MB/s Feb 27 22:23:43 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f205c60-79b6-4114-a170-891173e3d99a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:23:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:44 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD Feb 27 22:23:44 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:45 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD" returned: 0 in 1.262s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:45 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Temporary image b38627d9-9522-4831-a36d-1e8d5b5fd424 is fetched for user 6b9b19698a3740b6bc2a328c2aefe276. {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 22:23:45 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b265c6d-5314-416e-ab60-3cf212710e1e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:23:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:45 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD Feb 27 22:23:45 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:46 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD" returned: 0 in 1.464s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:23:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b720056c-4b2c-4715-8514-017c4acd9ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313dfaab0e04756876a3444935370cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:23:42Z,use_quota=True,user_id='6b9b19698a3740b6bc2a328c2aefe276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Creating volume b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:23:46 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:23:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:46 devstack sudo[85850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 1073741824 Feb 27 22:23:46 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:48 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 1073741824" returned: 0 in 1.720s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:48 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:23:48 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:49 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 0 in 1.092s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] <== create_volume: return (2925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:23:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.929s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:23:49 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Attempting download of b38627d9-9522-4831-a36d-1e8d5b5fd424 ((None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}])) to volume b720056c-4b2c-4715-8514-017c4acd9ab3. {{(pid=83540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Feb 27 22:23:49 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[45026d97-1988-408a-880a-c68478c8c9ec]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:23:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_kcao_oyj {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:49 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_kcao_oyj Feb 27 22:23:49 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:51 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_kcao_oyj" returned: 0 in 1.896s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_kcao_oyj {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:51 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_kcao_oyj Feb 27 22:23:51 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:53 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_kcao_oyj" returned: 1 in 1.542s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_kcao_oyj' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:23:53 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[80317e74-f4a3-4d3a-bb22-1b921645bfe9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:23:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:53 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD Feb 27 22:23:53 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:54 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD" returned: 0 in 1.609s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:54 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] b38627d9-9522-4831-a36d-1e8d5b5fd424 was qcow2, converting to raw {{(pid=83540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 22:23:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:54 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:23:54 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:57 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 0 in 2.537s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:57 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_6zf3e0eedevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:23:57 devstack cinder-volume[83540]: INFO cinder.image.image_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Converted 112.00 MB image at 44.11 MB/s Feb 27 22:23:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:57 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 1G Feb 27 22:23:57 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:58 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 1G" returned: 0 in 0.723s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:58 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[62494f8b-901d-4dce-b14d-fa99263d9e4e]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:23:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:58 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:23:58 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:59 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 0 in 0.847s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:23:59 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:23:59 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:23:59 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 1 in 0.802s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Downloaded image b38627d9-9522-4831-a36d-1e8d5b5fd424 ((None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}])) to volume b720056c-4b2c-4715-8514-017c4acd9ab3 successfully. {{(pid=83540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Temporary image b38627d9-9522-4831-a36d-1e8d5b5fd424 for user 6b9b19698a3740b6bc2a328c2aefe276 is deleted. {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Marking volume b720056c-4b2c-4715-8514-017c4acd9ab3 as bootable. {{(pid=83540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Copying metadata from image b38627d9-9522-4831-a36d-1e8d5b5fd424 to b720056c-4b2c-4715-8514-017c4acd9ab3. {{(pid=83540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 22:23:59 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Creating volume glance metadata for volume b720056c-4b2c-4715-8514-017c4acd9ab3 backed by image b38627d9-9522-4831-a36d-1e8d5b5fd424 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f24f119-b542-4999-8c69-6f4267b9547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b720056c-4b2c-4715-8514-017c4acd9ab3', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb1f991-7a5c-4394-a663-4e9cf6bb89d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:00 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Volume volume-b720056c-4b2c-4715-8514-017c4acd9ab3 (b720056c-4b2c-4715-8514-017c4acd9ab3): created successfully Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb1f991-7a5c-4394-a663-4e9cf6bb89d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Flow 'volume_create_manager' (b3c9c99e-d841-4210-ba52-a0da63b1036c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-2f8ed999-69f5-4ed4-9845-d6e4e58b5c9a tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Created volume successfully. Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Flow 'volume_create_manager' (d0eefc9f-cbd8-4b78-ac85-ce64a2bc8034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2705623-b47c-4a31-829b-84cf92be7648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2705623-b47c-4a31-829b-84cf92be7648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1067838319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f875164c8d64adbaa2f6a9e5a713e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:01Z,use_quota=True,user_id='7508fe4098e94ac7b980fb5f03ba32ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422b27df-1dea-4aaa-86c6-5864460e177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422b27df-1dea-4aaa-86c6-5864460e177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fff6d0b-053e-4818-b4cf-a49d121cde11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fff6d0b-053e-4818-b4cf-a49d121cde11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8', 'volume_name': 'volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d351a846-0e10-46c9-9535-5cc87d03fc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d351a846-0e10-46c9-9535-5cc87d03fc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1c2041-7336-44ed-8a0f-2bfbf333ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:00 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Volume 8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8', 'volume_size': 1} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1067838319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f875164c8d64adbaa2f6a9e5a713e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:01Z,use_quota=True,user_id='7508fe4098e94ac7b980fb5f03ba32ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Creating volume 8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:00 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:00 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 1073741824 Feb 27 22:24:00 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:01 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 1073741824" returned: 0 in 0.718s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:01 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 Feb 27 22:24:01 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:02 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8" returned: 0 in 0.528s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.104s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1c2041-7336-44ed-8a0f-2bfbf333ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb54460e-d881-454a-a653-f46b96586aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca7608-b158-4d80-b1b6-c4866b62657c]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:02 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Volume volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 (8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8): created successfully Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb54460e-d881-454a-a653-f46b96586aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Flow 'volume_create_manager' (d0eefc9f-cbd8-4b78-ac85-ce64a2bc8034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:02 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a467f2a7-f472-45ae-979a-75dd9e7b01bb tempest-ServersNegativeTestJSON-224000616 None] Created volume successfully. Feb 27 22:24:02 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:24:02 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:02 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 0 in 0.669s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:03 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:24:03 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:03 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 1 in 0.785s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:24:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.514s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6', 'name': 'volume-b720056c-4b2c-4715-8514-017c4acd9ab3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14eaf8d0-8dfe-4d5b-902d-1e6fad71d80f', 'enforce_multipath': True} {{(pid=83540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4927}} Feb 27 22:24:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-a803eaf4-9977-440e-8cad-d658a26c3f17 req-b782b3ff-8ffe-46ba-8ff1-4418c7e44825 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] attachment_update completed successfully. Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Flow 'volume_create_manager' (07a1bdef-c495-4693-9b39-de38a98c3abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f24110f-274b-4a63-9111-db17b291c6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f24110f-274b-4a63-9111-db17b291c6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-179702660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ac141e-aaec-4458-937a-de3226a21d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f875164c8d64adbaa2f6a9e5a713e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:04Z,use_quota=True,user_id='7508fe4098e94ac7b980fb5f03ba32ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6821d36-5197-4c67-aedb-d79bd73080bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6821d36-5197-4c67-aedb-d79bd73080bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0255af-91de-4a75-a410-e866f2dd3d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0255af-91de-4a75-a410-e866f2dd3d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ac141e-aaec-4458-937a-de3226a21d24', 'volume_name': 'volume-93ac141e-aaec-4458-937a-de3226a21d24', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b136204f-b401-4ef0-93fc-0a18064d1c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b136204f-b401-4ef0-93fc-0a18064d1c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64c4252-d819-441b-af3b-8ded92eb4f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:04 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Volume 93ac141e-aaec-4458-937a-de3226a21d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ac141e-aaec-4458-937a-de3226a21d24', 'volume_size': 1} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-179702660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ac141e-aaec-4458-937a-de3226a21d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f875164c8d64adbaa2f6a9e5a713e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:04Z,use_quota=True,user_id='7508fe4098e94ac7b980fb5f03ba32ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Creating volume 93ac141e-aaec-4458-937a-de3226a21d24 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:04 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:04 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 1073741824 Feb 27 22:24:04 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:05 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 1073741824" returned: 0 in 0.772s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:05 devstack sudo[86033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 Feb 27 22:24:05 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:06 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24" returned: 0 in 0.853s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64c4252-d819-441b-af3b-8ded92eb4f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ac141e-aaec-4458-937a-de3226a21d24', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e9364d-2c23-4e41-afe5-378045b8f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:06 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Volume volume-93ac141e-aaec-4458-937a-de3226a21d24 (93ac141e-aaec-4458-937a-de3226a21d24): created successfully Feb 27 22:24:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e9364d-2c23-4e41-afe5-378045b8f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Flow 'volume_create_manager' (07a1bdef-c495-4693-9b39-de38a98c3abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:06 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3f5c1912-bb6f-4f58-b6fb-d46bd5c7e8d8 tempest-ServersNegativeTestJSON-224000616 None] Created volume successfully. Feb 27 22:24:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "cinder-93ac141e-aaec-4458-937a-de3226a21d24-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Lock "cinder-93ac141e-aaec-4458-937a-de3226a21d24-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "cinder-quobyte-93ac141e-aaec-4458-937a-de3226a21d24" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Lock "cinder-quobyte-93ac141e-aaec-4458-937a-de3226a21d24" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:07 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc52a9bb-02a4-4a87-a08c-a08d2a04c679]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:07 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 Feb 27 22:24:07 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:08 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24" returned: 0 in 0.857s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:08 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24 Feb 27 22:24:08 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:09 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-93ac141e-aaec-4458-937a-de3226a21d24" returned: 0 in 0.936s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Lock "cinder-quobyte-93ac141e-aaec-4458-937a-de3226a21d24" released by "delete_volume" :: held 1.897s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (e787235c-f998-4632-b866-3810492e33df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19277f41-a12c-4744-9cbd-b27b3b7c74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19277f41-a12c-4744-9cbd-b27b3b7c74e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-981338587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdd1abd-5310-4f09-95c5-59fa41d5da62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:09Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10344fc8-33e5-419c-99ec-9946490416bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10344fc8-33e5-419c-99ec-9946490416bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6863daba-e20e-4545-8c80-5780a3fee51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6863daba-e20e-4545-8c80-5780a3fee51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bdd1abd-5310-4f09-95c5-59fa41d5da62', 'volume_name': 'volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8cbaf4-e8ee-433a-8da2-97b6539b922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8cbaf4-e8ee-433a-8da2-97b6539b922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107aa1bd-c0cf-4fd7-9e5a-726bbe756daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:09 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Volume 3bdd1abd-5310-4f09-95c5-59fa41d5da62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62', 'volume_size': 1} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-981338587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdd1abd-5310-4f09-95c5-59fa41d5da62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:09Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Creating volume 3bdd1abd-5310-4f09-95c5-59fa41d5da62 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:09 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:09 devstack sudo[86072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 1073741824 Feb 27 22:24:09 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Created reservations ['26adf8f5-be92-4e6e-8c92-2622c5954ab8', 'a12e811c-d48c-409b-bc25-b14bd2198d4d', '2927dcdb-292d-4c4d-93e9-97b0c634e002', '24ed89fa-f783-4952-a50b-4aed4a849d5b'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:09 devstack sudo[86075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:09 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "cinder-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Lock "cinder-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "cinder-quobyte-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Lock "cinder-quobyte-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8" acquired by "delete_volume" :: waited 0.033s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab8195-ed81-4ce7-92f3-7a51bb76c470]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:11 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.371s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Deleted volume successfully. Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-874e5567-08b2-40ad-8840-57927128a9ab tempest-ServersNegativeTestJSON-224000616 None] Lock "cinder-93ac141e-aaec-4458-937a-de3226a21d24-delete_volume" released by "delete_volume" :: held 3.969s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:11 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 1073741824" returned: 0 in 1.634s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:11 devstack sudo[86082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 Feb 27 22:24:11 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:11 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 Feb 27 22:24:11 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:12 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62" returned: 0 in 0.685s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] <== create_volume: return (2395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.399s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107aa1bd-c0cf-4fd7-9e5a-726bbe756daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d66e65-e72e-494a-b0d0-b349e62105ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:12 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Volume volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 (3bdd1abd-5310-4f09-95c5-59fa41d5da62): created successfully Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d66e65-e72e-494a-b0d0-b349e62105ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (e787235c-f998-4632-b866-3810492e33df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:12 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f00c6ca3-9849-4fd5-acd4-8ae056731d78 tempest-VolumesActionsTest-64622622 None] Created volume successfully. Feb 27 22:24:12 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8" returned: 0 in 1.439s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:12 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8 Feb 27 22:24:12 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97c49f01-f91a-4c61-bd9a-f7f780b88ff1 tempest-VolumesActionsTest-64622622 None] Acquiring lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62" by "attach_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97c49f01-f91a-4c61-bd9a-f7f780b88ff1 tempest-VolumesActionsTest-64622622 None] Lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62" acquired by "attach_volume" :: waited 0.047s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:12 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-97c49f01-f91a-4c61-bd9a-f7f780b88ff1 tempest-VolumesActionsTest-64622622 None] Attaching volume 3bdd1abd-5310-4f09-95c5-59fa41d5da62 to instance 5137b489-aee0-4088-bf08-a4bdbb9cbbb3 at mountpoint /dev/vdb on host None. Feb 27 22:24:12 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-97c49f01-f91a-4c61-bd9a-f7f780b88ff1 tempest-VolumesActionsTest-64622622 None] Attach volume completed successfully. Feb 27 22:24:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97c49f01-f91a-4c61-bd9a-f7f780b88ff1 tempest-VolumesActionsTest-64622622 None] Lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62" released by "attach_volume" :: held 0.168s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:13 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8" returned: 0 in 0.950s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Lock "cinder-quobyte-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8" released by "delete_volume" :: held 2.458s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Created reservations ['526d9258-7c0c-4bbf-abc1-bb089fedb70e', '4e037722-7304-483d-a6ac-d6a650d934c0', '987c1a0c-a0cf-4813-91e7-6d59b1889f1d', '77bc6e6e-c5a5-4208-81c0-f01dd05d4e2c'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:14 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:14 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:14 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a2b6d56c-ba7e-470a-a734-888cdda91fdd tempest-VolumesActionsTest-1493087227 None] Terminate volume connection completed successfully. Feb 27 22:24:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2b6d56c-ba7e-470a-a734-888cdda91fdd tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-detach_volume" by "detach_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2b6d56c-ba7e-470a-a734-888cdda91fdd tempest-VolumesActionsTest-1493087227 None] Lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:14 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.026s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:14 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:14 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Deleted volume successfully. Feb 27 22:24:14 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a2b6d56c-ba7e-470a-a734-888cdda91fdd tempest-VolumesActionsTest-1493087227 None] Detaching volume 3bdd1abd-5310-4f09-95c5-59fa41d5da62 from instance 5137b489-aee0-4088-bf08-a4bdbb9cbbb3. Feb 27 22:24:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ef200d1a-b76d-4f62-9ef1-3f733775e9b0 tempest-ServersNegativeTestJSON-224000616 None] Lock "cinder-8eaf308b-4ca0-4f19-ab27-c4aa7f2f66c8-delete_volume" released by "delete_volume" :: held 4.156s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:15 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a2b6d56c-ba7e-470a-a734-888cdda91fdd tempest-VolumesActionsTest-1493087227 None] Detach volume completed successfully. Feb 27 22:24:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2b6d56c-ba7e-470a-a734-888cdda91fdd tempest-VolumesActionsTest-1493087227 None] Lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-detach_volume" released by "detach_volume" :: held 0.168s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-596a9edf-f7a2-4f5b-9d6a-93ed7a88a719 tempest-VolumesActionsTest-64622622 None] Acquiring lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-detach_volume" by "detach_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-596a9edf-f7a2-4f5b-9d6a-93ed7a88a719 tempest-VolumesActionsTest-64622622 None] Lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:15 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-596a9edf-f7a2-4f5b-9d6a-93ed7a88a719 tempest-VolumesActionsTest-64622622 None] Volume detach called, but volume not attached. Feb 27 22:24:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-596a9edf-f7a2-4f5b-9d6a-93ed7a88a719 tempest-VolumesActionsTest-64622622 None] Lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Acquiring lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Acquiring lock "cinder-quobyte-3bdd1abd-5310-4f09-95c5-59fa41d5da62" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Lock "cinder-quobyte-3bdd1abd-5310-4f09-95c5-59fa41d5da62" acquired by "delete_volume" :: waited 0.040s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:16 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52977e8-50f4-4530-a6d4-577e7741a0a4]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:17 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 Feb 27 22:24:17 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:18 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62" returned: 0 in 2.026s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:18 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62 Feb 27 22:24:18 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:19 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3bdd1abd-5310-4f09-95c5-59fa41d5da62" returned: 0 in 1.159s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:20 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Lock "cinder-quobyte-3bdd1abd-5310-4f09-95c5-59fa41d5da62" released by "delete_volume" :: held 3.294s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:20 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Created reservations ['539c1301-652a-4df4-937f-199998bc55fd', 'bc56902c-5ed0-439d-b326-b9279bed0435', '48f0071d-d105-4acf-8e7c-b85d66832530', '851ab262-102f-4cd2-ac03-baac093fa6e9'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:20 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:20 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:21 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.911s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:21 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:21 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Deleted volume successfully. Feb 27 22:24:21 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f1334717-fcff-493f-ad0a-cbea5b34d036 tempest-VolumesActionsTest-64622622 None] Lock "cinder-3bdd1abd-5310-4f09-95c5-59fa41d5da62-delete_volume" released by "delete_volume" :: held 4.590s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=41,cinder:INSERT=17,cinder:UPDATE=40,cinder:DELETE=1 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (05a41dc9-a3cd-4f0c-bb4e-5adfadbede0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac4a3fd-2c8a-4598-b84f-01ad9f3ac443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac4a3fd-2c8a-4598-b84f-01ad9f3ac443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2018660566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a04a23-9807-483e-bbf9-277aa60fa98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:31Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd82a4d-415c-45fd-9516-0d4251a909f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd82a4d-415c-45fd-9516-0d4251a909f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd98e91d-05e0-41ab-8c51-c90999006fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd98e91d-05e0-41ab-8c51-c90999006fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a04a23-9807-483e-bbf9-277aa60fa98a', 'volume_name': 'volume-a5a04a23-9807-483e-bbf9-277aa60fa98a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f23d88-0aad-4b9f-bbd8-a2a489826c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f23d88-0aad-4b9f-bbd8-a2a489826c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf5040b-8cd1-401f-9999-cc759ce192ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:30 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Volume a5a04a23-9807-483e-bbf9-277aa60fa98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a04a23-9807-483e-bbf9-277aa60fa98a', 'volume_size': 1} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2018660566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a04a23-9807-483e-bbf9-277aa60fa98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:31Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Creating volume a5a04a23-9807-483e-bbf9-277aa60fa98a {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:30 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:30 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a 1073741824 Feb 27 22:24:30 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:30 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Flow 'volume_create_manager' (f7e43d10-775c-42b4-89c1-cd40742dc217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de16e44-326a-49d9-bda1-07b9431331c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de16e44-326a-49d9-bda1-07b9431331c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-989781674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdf0046-6f6d-4b43-9542-f52adc513b43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='722782f126fc411dae57851d1200fdd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:31Z,use_quota=True,user_id='f00c54bd7b7f40218c7847ef6a083ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55236e15-5172-47f6-a02d-c44373b6c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55236e15-5172-47f6-a02d-c44373b6c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc9b1d-f514-4718-94fb-3919611bd295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc9b1d-f514-4718-94fb-3919611bd295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bdf0046-6f6d-4b43-9542-f52adc513b43', 'volume_name': 'volume-4bdf0046-6f6d-4b43-9542-f52adc513b43', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a70845-2752-4951-a59f-da1cb1d5d806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a70845-2752-4951-a59f-da1cb1d5d806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3012f0-849b-4275-ab6f-20086e1033d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:31 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Volume 4bdf0046-6f6d-4b43-9542-f52adc513b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bdf0046-6f6d-4b43-9542-f52adc513b43', 'volume_size': 1} Feb 27 22:24:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:32 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a 1073741824" returned: 0 in 1.258s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:32 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a Feb 27 22:24:32 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:32 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a" returned: 0 in 0.620s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-989781674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdf0046-6f6d-4b43-9542-f52adc513b43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='722782f126fc411dae57851d1200fdd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:31Z,use_quota=True,user_id='f00c54bd7b7f40218c7847ef6a083ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Creating volume 4bdf0046-6f6d-4b43-9542-f52adc513b43 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:32 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:32 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 1073741824 Feb 27 22:24:32 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf5040b-8cd1-401f-9999-cc759ce192ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a04a23-9807-483e-bbf9-277aa60fa98a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2908e92c-279c-440e-babb-9b415b41b80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:32 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Volume volume-a5a04a23-9807-483e-bbf9-277aa60fa98a (a5a04a23-9807-483e-bbf9-277aa60fa98a): created successfully Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2908e92c-279c-440e-babb-9b415b41b80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (05a41dc9-a3cd-4f0c-bb4e-5adfadbede0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:32 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8c539e02-7b2c-4a37-867f-707a75ee8662 tempest-VolumesActionsTest-64622622 None] Created volume successfully. Feb 27 22:24:33 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 1073741824" returned: 0 in 0.976s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:33 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 Feb 27 22:24:33 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-a5a04a23-9807-483e-bbf9-277aa60fa98a-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-a5a04a23-9807-483e-bbf9-277aa60fa98a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-quobyte-a5a04a23-9807-483e-bbf9-277aa60fa98a" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-quobyte-a5a04a23-9807-483e-bbf9-277aa60fa98a" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0503a-5619-4490-9c03-cdb5e67465b5]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:34 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a Feb 27 22:24:34 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:34 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43" returned: 0 in 0.727s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3012f0-849b-4275-ab6f-20086e1033d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bdf0046-6f6d-4b43-9542-f52adc513b43', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e05e7c-f6e2-4cc7-a702-38fd9006c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:34 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Volume volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 (4bdf0046-6f6d-4b43-9542-f52adc513b43): created successfully Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e05e7c-f6e2-4cc7-a702-38fd9006c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Flow 'volume_create_manager' (f7e43d10-775c-42b4-89c1-cd40742dc217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:34 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-69a0e618-845c-4464-8f84-275930e96d3b req-a9496c8c-9c44-4ea8-85d5-1b9e5c2e3f8a tempest-VolumesGetTestJSON-1005234230 None] Created volume successfully. Feb 27 22:24:35 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a" returned: 0 in 0.866s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:35 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a Feb 27 22:24:35 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Acquiring lock "cinder-4bdf0046-6f6d-4b43-9542-f52adc513b43-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Lock "cinder-4bdf0046-6f6d-4b43-9542-f52adc513b43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Acquiring lock "cinder-quobyte-4bdf0046-6f6d-4b43-9542-f52adc513b43" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Lock "cinder-quobyte-4bdf0046-6f6d-4b43-9542-f52adc513b43" acquired by "delete_volume" :: waited 0.037s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:35 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac1f9e-779d-47a7-9e52-95a73d89edb8]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:35 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 Feb 27 22:24:35 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:35 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5a04a23-9807-483e-bbf9-277aa60fa98a" returned: 0 in 0.853s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-quobyte-a5a04a23-9807-483e-bbf9-277aa60fa98a" released by "delete_volume" :: held 1.752s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Created reservations ['ce0bca7a-17f0-4561-b5cf-b0b5d99e5dea', '863ce2c1-c968-4554-8515-0c81aa27bdea', 'd0bda27a-56f0-4f9f-b0a1-2f95970c4565', '05f9a171-91b8-4aa1-9308-0477c5b93292'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:36 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43" returned: 0 in 0.864s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:36 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:36 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:36 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43 Feb 27 22:24:36 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:37 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4bdf0046-6f6d-4b43-9542-f52adc513b43" returned: 0 in 0.892s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Lock "cinder-quobyte-4bdf0046-6f6d-4b43-9542-f52adc513b43" released by "delete_volume" :: held 1.810s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:37 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.quota [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Created reservations ['5ea28e45-028a-44af-9bcb-7ca805e4e6af', '429ab9d6-bcca-49a8-b7de-1e8828c93b14', '318ccd6b-e7dd-410f-91cd-cee90798c550', '2ec7eef2-36d4-47e6-9a51-360443cdefcb'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.986s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:37 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Deleted volume successfully. Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-75ebd144-9999-4c62-91da-128bec3393b1 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-a5a04a23-9807-483e-bbf9-277aa60fa98a-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:37 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (a9bbd58e-d94a-4a58-8c5f-45b528689645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:37 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3091a94-a48f-4fff-a3ae-ef1b6b12fd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3091a94-a48f-4fff-a3ae-ef1b6b12fd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-447982686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916600a6-146e-406d-97a9-901d78c7fcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:37Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa2b065-8d27-4c04-b44a-29824958fa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa2b065-8d27-4c04-b44a-29824958fa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6ccc25-6cab-4b90-b628-c6b2144af567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6ccc25-6cab-4b90-b628-c6b2144af567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916600a6-146e-406d-97a9-901d78c7fcb3', 'volume_name': 'volume-916600a6-146e-406d-97a9-901d78c7fcb3', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2695a3f1-3357-4b64-ac7e-c476a008f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2695a3f1-3357-4b64-ac7e-c476a008f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a7d099-9e36-4040-8e59-fc9834d96c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:37 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Volume 916600a6-146e-406d-97a9-901d78c7fcb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916600a6-146e-406d-97a9-901d78c7fcb3', 'volume_size': 1} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-447982686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916600a6-146e-406d-97a9-901d78c7fcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:37Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Creating volume 916600a6-146e-406d-97a9-901d78c7fcb3 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:37 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:37 devstack sudo[86388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 1073741824 Feb 27 22:24:37 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Flow 'volume_create_manager' (46cd216c-9130-4f74-a5cc-0b71971047a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc38c18-6696-4053-a28e-91e6891f443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc38c18-6696-4053-a28e-91e6891f443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-102277316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40c4103-0f11-4fd2-a65d-dc493a745286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd480ce07e9245b49db2ef57b48bcbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:38Z,use_quota=True,user_id='f446b8cfd59843abb8825152d5ba5f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a130ca8f-e456-44c6-ba28-3b1b883db33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a130ca8f-e456-44c6-ba28-3b1b883db33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a81976-9ac8-47ce-af68-c94852d6b057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a81976-9ac8-47ce-af68-c94852d6b057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40c4103-0f11-4fd2-a65d-dc493a745286', 'volume_name': 'volume-f40c4103-0f11-4fd2-a65d-dc493a745286', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123bb055-c173-4074-9958-ad2626b0ecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123bb055-c173-4074-9958-ad2626b0ecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0df0996-0b18-45b6-9563-51c181482ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:38 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Volume f40c4103-0f11-4fd2-a65d-dc493a745286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40c4103-0f11-4fd2-a65d-dc493a745286', 'volume_size': 1} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:38 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 1073741824" returned: 0 in 0.810s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:38 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 Feb 27 22:24:38 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:38 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.128s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.manager [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:38 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Deleted volume successfully. Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-f3f2206f-a178-46f5-afd9-2c37ddffcb15 req-4ccec2da-aa36-4771-a874-522bcf26e7fa tempest-VolumesGetTestJSON-1005234230 None] Lock "cinder-4bdf0046-6f6d-4b43-9542-f52adc513b43-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:38 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-a3b081a7-4015-4b26-b15a-35965b322afc req-244649da-e6c6-46bb-95b2-0f2581360080 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Terminate volume connection completed successfully. Feb 27 22:24:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-a3b081a7-4015-4b26-b15a-35965b322afc req-244649da-e6c6-46bb-95b2-0f2581360080 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Deleting attachment 14eaf8d0-8dfe-4d5b-902d-1e6fad71d80f. {{(pid=83540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5058}} Feb 27 22:24:39 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3" returned: 0 in 0.655s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-102277316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40c4103-0f11-4fd2-a65d-dc493a745286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd480ce07e9245b49db2ef57b48bcbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:38Z,use_quota=True,user_id='f446b8cfd59843abb8825152d5ba5f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Creating volume f40c4103-0f11-4fd2-a65d-dc493a745286 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:39 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a7d099-9e36-4040-8e59-fc9834d96c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916600a6-146e-406d-97a9-901d78c7fcb3', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39a70b8-d07a-40e6-9598-4e1aab4cf6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:39 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Volume volume-916600a6-146e-406d-97a9-901d78c7fcb3 (916600a6-146e-406d-97a9-901d78c7fcb3): created successfully Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39a70b8-d07a-40e6-9598-4e1aab4cf6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (a9bbd58e-d94a-4a58-8c5f-45b528689645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:39 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c809b699-1933-4af0-91e3-1cb4f6a00eaf tempest-VolumesActionsTest-64622622 None] Created volume successfully. Feb 27 22:24:39 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 1073741824 Feb 27 22:24:39 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "cinder-b720056c-4b2c-4715-8514-017c4acd9ab3-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "cinder-b720056c-4b2c-4715-8514-017c4acd9ab3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "cinder-quobyte-b720056c-4b2c-4715-8514-017c4acd9ab3" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "cinder-quobyte-b720056c-4b2c-4715-8514-017c4acd9ab3" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1454e23c-2ae9-4e9c-977c-c532c68b74bc]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:39 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:24:39 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-916600a6-146e-406d-97a9-901d78c7fcb3-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Lock "cinder-916600a6-146e-406d-97a9-901d78c7fcb3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-quobyte-916600a6-146e-406d-97a9-901d78c7fcb3" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Lock "cinder-quobyte-916600a6-146e-406d-97a9-901d78c7fcb3" acquired by "delete_volume" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f308d4-240f-452d-b5ac-cb5c49be2f6b]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:40 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 Feb 27 22:24:40 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:40 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 0 in 0.907s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:40 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:24:40 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:40 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 1073741824" returned: 0 in 1.414s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:40 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 Feb 27 22:24:40 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:40 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3" returned: 0 in 1.050s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:41 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3 Feb 27 22:24:41 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:41 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:41 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:41 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 1 in 1.138s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:41 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3 Feb 27 22:24:41 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:41 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286" returned: 0 in 1.017s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] <== create_volume: return (2520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.523s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0df0996-0b18-45b6-9563-51c181482ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40c4103-0f11-4fd2-a65d-dc493a745286', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc109f0-c92c-48f2-b0b5-f3f46f19a30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:41 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Volume volume-f40c4103-0f11-4fd2-a65d-dc493a745286 (f40c4103-0f11-4fd2-a65d-dc493a745286): created successfully Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc109f0-c92c-48f2-b0b5-f3f46f19a30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Flow 'volume_create_manager' (46cd216c-9130-4f74-a5cc-0b71971047a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:41 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f70cfb7c-b6bc-4c5b-afaa-a152751a9400 tempest-DeleteServersTestJSON-1248235940 None] Created volume successfully. Feb 27 22:24:41 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.869s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:24:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:24:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:24:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:24:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:24:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:24:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:24:42 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-916600a6-146e-406d-97a9-901d78c7fcb3" returned: 0 in 1.112s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Lock "cinder-quobyte-916600a6-146e-406d-97a9-901d78c7fcb3" released by "delete_volume" :: held 2.301s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Created reservations ['41982c09-4149-431b-8976-b0a737e5a337', 'de3cc6ab-36c1-4068-9b32-4a166f60f4d2', '5debf05c-d24b-4767-af61-383a34626480', '800536c7-d0bd-4a6b-bec4-26821223e32d'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:42 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:42 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:42 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b720056c-4b2c-4715-8514-017c4acd9ab3" returned: 0 in 1.043s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "cinder-quobyte-b720056c-4b2c-4715-8514-017c4acd9ab3" released by "delete_volume" :: held 3.156s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG cinder.quota [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Created reservations ['638c7c95-4510-4144-bb99-5719d8f12528', '254d2849-3c3c-4125-8822-eeb91a8e3c3b', 'ad3b0ce2-f6f6-47ed-8f4e-d970102b1999', '84c54e23-d7bb-44bc-9aaf-1799a53ade03'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:42 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:42 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:43 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.958s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:43 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Deleted volume successfully. Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f476e6c2-7976-478e-879d-d6258d42236f tempest-VolumesActionsTest-1493087227 None] Lock "cinder-916600a6-146e-406d-97a9-901d78c7fcb3-delete_volume" released by "delete_volume" :: held 3.538s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (9dc1ae00-3e69-4587-9a17-87e07044f61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46a1629-9347-499d-89b9-b90380ddbb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46a1629-9347-499d-89b9-b90380ddbb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-681017734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d85fa52-9a48-43ca-9bae-cd23b8e201d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:43Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a345dd-a860-4029-9c09-d545f1dae1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a345dd-a860-4029-9c09-d545f1dae1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735298eb-edc7-4b08-badf-6ebeb5b70ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735298eb-edc7-4b08-badf-6ebeb5b70ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d85fa52-9a48-43ca-9bae-cd23b8e201d2', 'volume_name': 'volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf5e1db-e49f-48b8-8846-875684def7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf5e1db-e49f-48b8-8846-875684def7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116412b6-0a19-4e26-8f7e-1a49f2cd96f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:43 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Volume 3d85fa52-9a48-43ca-9bae-cd23b8e201d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2', 'volume_size': 1} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-681017734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d85fa52-9a48-43ca-9bae-cd23b8e201d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:43Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Creating volume 3d85fa52-9a48-43ca-9bae-cd23b8e201d2 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:43 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:43 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 1073741824 Feb 27 22:24:43 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:43 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.852s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.manager [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:43 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Deleted volume successfully. Feb 27 22:24:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-a3b081a7-4015-4b26-b15a-35965b322afc req-b9afa8c1-8a49-4dd0-b366-bd8c832a3913 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "cinder-b720056c-4b2c-4715-8514-017c4acd9ab3-delete_volume" released by "delete_volume" :: held 4.395s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Flow 'volume_create_manager' (df98dfda-a307-4d8a-8656-463c50e88214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c472c91-9ade-4569-9958-0ff8813c85a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c472c91-9ade-4569-9958-0ff8813c85a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-98657767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cfceda-fd93-4b43-b07a-c2aa3eef3c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95f7a3b86654c71b30ffc6d605d5490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:44Z,use_quota=True,user_id='8365480b633f46f4ac159c3d45ce0a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14593542-ae3f-4ec8-b019-a9840a519415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14593542-ae3f-4ec8-b019-a9840a519415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322d365b-e4ca-4acb-9524-12d4011e9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322d365b-e4ca-4acb-9524-12d4011e9d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cfceda-fd93-4b43-b07a-c2aa3eef3c86', 'volume_name': 'volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d24427e-d85b-4ea0-a249-3cfe2bb1186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d24427e-d85b-4ea0-a249-3cfe2bb1186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a936d91d-26a4-4a41-bb6b-6a791bb873ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Volume d4cfceda-fd93-4b43-b07a-c2aa3eef3c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86', 'volume_size': 1} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:44 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 1073741824" returned: 0 in 0.938s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:44 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 Feb 27 22:24:44 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:45 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2" returned: 0 in 0.548s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-98657767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cfceda-fd93-4b43-b07a-c2aa3eef3c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95f7a3b86654c71b30ffc6d605d5490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:44Z,use_quota=True,user_id='8365480b633f46f4ac159c3d45ce0a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Creating volume d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:45 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116412b6-0a19-4e26-8f7e-1a49f2cd96f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951427de-26fd-4728-a206-8c661e4e198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:45 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Volume volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 (3d85fa52-9a48-43ca-9bae-cd23b8e201d2): created successfully Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951427de-26fd-4728-a206-8c661e4e198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (9dc1ae00-3e69-4587-9a17-87e07044f61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:45 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 1073741824 Feb 27 22:24:45 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:45 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6c50fe62-2f08-4461-b86b-c457192b045c tempest-VolumesActionsTest-64622622 None] Created volume successfully. Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-3d85fa52-9a48-43ca-9bae-cd23b8e201d2-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-3d85fa52-9a48-43ca-9bae-cd23b8e201d2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-quobyte-3d85fa52-9a48-43ca-9bae-cd23b8e201d2" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-quobyte-3d85fa52-9a48-43ca-9bae-cd23b8e201d2" acquired by "delete_volume" :: waited 0.025s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a67b294-826a-4e54-98a5-cd683fbce56b]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:46 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 Feb 27 22:24:46 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-7765e531-b6ba-41f0-b315-e878f4994e01 req-940fcfa7-aa7a-4d96-9638-8865db06a9ee tempest-DeleteServersTestJSON-1248235940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:46 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 1073741824" returned: 0 in 1.267s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:46 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 Feb 27 22:24:46 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:46 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2" returned: 0 in 0.818s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:46 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2 Feb 27 22:24:46 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:47 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86" returned: 0 in 1.186s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] <== create_volume: return (2511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.516s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-7765e531-b6ba-41f0-b315-e878f4994e01 req-940fcfa7-aa7a-4d96-9638-8865db06a9ee tempest-DeleteServersTestJSON-1248235940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.452s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a936d91d-26a4-4a41-bb6b-6a791bb873ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b314e2-a449-4c8d-bb29-db1ac3d1b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62d445c-c980-44a2-8cfe-9205bd254082]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-7765e531-b6ba-41f0-b315-e878f4994e01 req-940fcfa7-aa7a-4d96-9638-8865db06a9ee tempest-DeleteServersTestJSON-1248235940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:47 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Volume volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 (d4cfceda-fd93-4b43-b07a-c2aa3eef3c86): created successfully Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b314e2-a449-4c8d-bb29-db1ac3d1b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Flow 'volume_create_manager' (df98dfda-a307-4d8a-8656-463c50e88214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:47 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:47 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4906a2a6-40ed-464a-9c37-fb6335d67c46 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Created volume successfully. Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3d85fa52-9a48-43ca-9bae-cd23b8e201d2" returned: 0 in 1.019s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:47 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 Feb 27 22:24:47 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-quobyte-3d85fa52-9a48-43ca-9bae-cd23b8e201d2" released by "delete_volume" :: held 1.911s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:47 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Created reservations ['aede383a-909e-44a1-9ba1-e0e1fc212579', '587336a7-dc88-4bf6-b42e-c6ecfdd36777', 'ebf3325a-8d3f-46f7-a09a-80ae1696028a', '5d7a1a3b-6f48-42f9-aa13-b0049a7fcad5'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:48 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:48 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:48 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-7765e531-b6ba-41f0-b315-e878f4994e01 req-940fcfa7-aa7a-4d96-9638-8865db06a9ee tempest-DeleteServersTestJSON-1248235940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286" returned: 0 in 0.795s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-7765e531-b6ba-41f0-b315-e878f4994e01 req-940fcfa7-aa7a-4d96-9638-8865db06a9ee tempest-DeleteServersTestJSON-1248235940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-7765e531-b6ba-41f0-b315-e878f4994e01 req-940fcfa7-aa7a-4d96-9638-8865db06a9ee tempest-DeleteServersTestJSON-1248235940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6', 'name': 'volume-f40c4103-0f11-4fd2-a65d-dc493a745286', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '935a9927-9c2d-49b5-94eb-54cc2995aca0', 'enforce_multipath': True} {{(pid=83540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4927}} Feb 27 22:24:48 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-7765e531-b6ba-41f0-b315-e878f4994e01 req-940fcfa7-aa7a-4d96-9638-8865db06a9ee tempest-DeleteServersTestJSON-1248235940 None] attachment_update completed successfully. Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (01af7d91-c0a3-4086-a799-e1b3a95d5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4363c0-0fd0-49e7-9b90-06befc6bad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4363c0-0fd0-49e7-9b90-06befc6bad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2085961581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e82aed8-9d9e-45fb-a808-0a562c17d871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:49Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd894a5-a9d9-4bcc-aff0-74395ad172d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd894a5-a9d9-4bcc-aff0-74395ad172d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da91380-792e-4dc5-b232-0032fac0f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da91380-792e-4dc5-b232-0032fac0f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e82aed8-9d9e-45fb-a808-0a562c17d871', 'volume_name': 'volume-5e82aed8-9d9e-45fb-a808-0a562c17d871', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9054ebff-da9a-41f5-b6a7-0150644fb34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9054ebff-da9a-41f5-b6a7-0150644fb34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7528d077-39f5-4e06-94b2-7e8cb72400ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:48 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Volume 5e82aed8-9d9e-45fb-a808-0a562c17d871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e82aed8-9d9e-45fb-a808-0a562c17d871', 'volume_size': 1} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2085961581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e82aed8-9d9e-45fb-a808-0a562c17d871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:49Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Creating volume 5e82aed8-9d9e-45fb-a808-0a562c17d871 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:48 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Acquiring lock "cinder-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "cinder-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:48 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 1073741824 Feb 27 22:24:48 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:48 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Acquiring lock "cinder-quobyte-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "cinder-quobyte-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:49 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.907s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:49 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Deleted volume successfully. Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a6172c-6328-46a0-9306-7e58281a88b9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f70b2139-8181-4c64-9ddc-1fad4b8255d4 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-3d85fa52-9a48-43ca-9bae-cd23b8e201d2-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:49 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 Feb 27 22:24:49 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:49 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86" returned: 0 in 0.574s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:49 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86 Feb 27 22:24:49 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:49 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 1073741824" returned: 0 in 0.761s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:49 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 Feb 27 22:24:49 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:50 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86" returned: 0 in 0.481s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "cinder-quobyte-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86" released by "delete_volume" :: held 1.096s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Created reservations ['248c5fde-ec71-4b05-99d4-a05f8298b370', 'e8dbca88-d0b2-4f83-b433-f352f02d8bd5', '608e05e3-c0f7-4a72-b1a4-547893f2a3b7', '70d665da-ad95-4f17-a7db-0508bca977c8'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:50 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871" returned: 0 in 0.465s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7528d077-39f5-4e06-94b2-7e8cb72400ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e82aed8-9d9e-45fb-a808-0a562c17d871', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ab159d-dc49-4660-99d8-4fb5f677f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:50 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Volume volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 (5e82aed8-9d9e-45fb-a808-0a562c17d871): created successfully Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ab159d-dc49-4660-99d8-4fb5f677f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (01af7d91-c0a3-4086-a799-e1b3a95d5500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:50 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-32cd50d7-4607-4fe5-8533-f80fece9a324 tempest-VolumesActionsTest-64622622 None] Created volume successfully. Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:50 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:50 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:50 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.527s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:50 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Deleted volume successfully. Feb 27 22:24:50 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b1e2897-2b3d-4364-a7f1-15b184bfc8ff tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "cinder-d4cfceda-fd93-4b43-b07a-c2aa3eef3c86-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-5e82aed8-9d9e-45fb-a808-0a562c17d871-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-5e82aed8-9d9e-45fb-a808-0a562c17d871-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "cinder-quobyte-5e82aed8-9d9e-45fb-a808-0a562c17d871" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-quobyte-5e82aed8-9d9e-45fb-a808-0a562c17d871" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b967a0bf-429c-407e-86c2-f443c1754c1d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:51 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 Feb 27 22:24:51 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Flow 'volume_create_manager' (82749ae0-1136-45d4-8aa2-6b55091227a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3426a2c-9c93-4a00-9602-ef8867d0a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3426a2c-9c93-4a00-9602-ef8867d0a19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-159326999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcaf73b-428e-46cb-bda6-d762053973bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95f7a3b86654c71b30ffc6d605d5490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:51Z,use_quota=True,user_id='8365480b633f46f4ac159c3d45ce0a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803aa9cd-d325-4681-8bee-89e28f1293d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803aa9cd-d325-4681-8bee-89e28f1293d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee35738-a83e-4c15-bbc6-7a43c354b555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee35738-a83e-4c15-bbc6-7a43c354b555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcaf73b-428e-46cb-bda6-d762053973bc', 'volume_name': 'volume-5dcaf73b-428e-46cb-bda6-d762053973bc', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f92878-1f0f-4779-9c72-3e7b42a36eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f92878-1f0f-4779-9c72-3e7b42a36eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02099da3-c363-4f3f-b004-649af82b2a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:51 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Volume 5dcaf73b-428e-46cb-bda6-d762053973bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcaf73b-428e-46cb-bda6-d762053973bc', 'volume_size': 1} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-159326999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcaf73b-428e-46cb-bda6-d762053973bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95f7a3b86654c71b30ffc6d605d5490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:51Z,use_quota=True,user_id='8365480b633f46f4ac159c3d45ce0a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Creating volume 5dcaf73b-428e-46cb-bda6-d762053973bc {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:51 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:51 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc 1073741824 Feb 27 22:24:51 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:52 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871" returned: 0 in 1.273s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:52 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871 Feb 27 22:24:52 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:52 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc 1073741824" returned: 0 in 1.060s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:52 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc Feb 27 22:24:52 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:53 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e82aed8-9d9e-45fb-a808-0a562c17d871" returned: 0 in 0.589s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-quobyte-5e82aed8-9d9e-45fb-a808-0a562c17d871" released by "delete_volume" :: held 1.913s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Created reservations ['04cff15d-b3d0-48d5-a916-1294869b24a0', '47df88af-558a-4a12-b2e5-47e108313b32', '0a325ed4-22ee-4844-9066-e7976dd588a9', '15e113ce-71b4-431a-9927-b39ed78c25ca'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:53 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:53 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc" returned: 0 in 0.615s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:53 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02099da3-c363-4f3f-b004-649af82b2a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcaf73b-428e-46cb-bda6-d762053973bc', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6298e2e3-35b9-427e-bfc3-08187eb81be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:53 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Volume volume-5dcaf73b-428e-46cb-bda6-d762053973bc (5dcaf73b-428e-46cb-bda6-d762053973bc): created successfully Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6298e2e3-35b9-427e-bfc3-08187eb81be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:53 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Flow 'volume_create_manager' (82749ae0-1136-45d4-8aa2-6b55091227a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:53 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e7f0814a-4f75-4e7a-acf7-d94dec6c1dc8 tempest-VolumeQuotasAdminTestJSON-1721247399 None] Created volume successfully. Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (4a920eec-c3a3-474c-bf36-6bcc784056a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2f8579-f104-4fb6-b349-48fa7b78ca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2f8579-f104-4fb6-b349-48fa7b78ca64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-638015278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbfa234-0d82-43c7-bd1e-c52d8d78fa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:54Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb47a12-e088-48e6-b50a-b621c456a7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb47a12-e088-48e6-b50a-b621c456a7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88ae2f2-4f9c-4600-8707-7706c74abb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88ae2f2-4f9c-4600-8707-7706c74abb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbfa234-0d82-43c7-bd1e-c52d8d78fa71', 'volume_name': 'volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da59cffb-ea00-4cdb-85ad-a3d77be5f6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da59cffb-ea00-4cdb-85ad-a3d77be5f6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd431df3-aa28-421d-a0e3-a8a32ddcae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:54 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Volume bcbfa234-0d82-43c7-bd1e-c52d8d78fa71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71', 'volume_size': 1} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:54 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-638015278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbfa234-0d82-43c7-bd1e-c52d8d78fa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d094bdc0d84040f5ba23c7767c0fb7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:24:54Z,use_quota=True,user_id='1f08183b30e143d7989d3444de52b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Creating volume bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:24:54 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.945s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:54 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Deleted volume successfully. Feb 27 22:24:54 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 1073741824 Feb 27 22:24:54 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7cbb4604-e6d5-43e6-be1d-db4b0f9076a4 tempest-VolumesActionsTest-1493087227 None] Lock "cinder-5e82aed8-9d9e-45fb-a808-0a562c17d871-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:54 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-cc9bb65d-bfd5-452e-8f78-18fb6ff0c4c4 tempest-VolumeQuotasAdminTestJSON-2142765186 None] Transfer volume completed successfully. Feb 27 22:24:54 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-f5a3e38f-c9ee-4c48-b16c-7ad8384023c2 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Terminate volume connection completed successfully. Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-f5a3e38f-c9ee-4c48-b16c-7ad8384023c2 tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Deleting attachment 0e4d704f-8fa8-4d67-a979-b1996e9dcb83. {{(pid=83540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5058}} Feb 27 22:24:54 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 1073741824" returned: 0 in 0.763s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:55 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 Feb 27 22:24:55 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "cinder-45e53c38-b84e-47ee-8f97-119422c7b22a-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "cinder-45e53c38-b84e-47ee-8f97-119422c7b22a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "cinder-quobyte-45e53c38-b84e-47ee-8f97-119422c7b22a" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "cinder-quobyte-45e53c38-b84e-47ee-8f97-119422c7b22a" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d2a5ea-6e29-443c-8cef-67819b4965cb]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Acquiring lock "cinder-5dcaf73b-428e-46cb-bda6-d762053973bc-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Lock "cinder-5dcaf73b-428e-46cb-bda6-d762053973bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:55 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71" returned: 0 in 0.561s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Acquiring lock "cinder-quobyte-5dcaf73b-428e-46cb-bda6-d762053973bc" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Lock "cinder-quobyte-5dcaf73b-428e-46cb-bda6-d762053973bc" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd431df3-aa28-421d-a0e3-a8a32ddcae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014b05c5-ef5d-40fe-948b-7c7ebe36e603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fa32b1-ed14-4f6c-ad94-ec8105dd6114]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:55 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a Feb 27 22:24:55 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:55 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Volume volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 (bcbfa234-0d82-43c7-bd1e-c52d8d78fa71): created successfully Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014b05c5-ef5d-40fe-948b-7c7ebe36e603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:24:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Flow 'volume_create_manager' (4a920eec-c3a3-474c-bf36-6bcc784056a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:24:55 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6e006ff2-3881-46d6-874f-93d2f14debaa tempest-VolumesActionsTest-64622622 None] Created volume successfully. Feb 27 22:24:55 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc Feb 27 22:24:55 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:56 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a" returned: 0 in 0.672s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:56 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a Feb 27 22:24:56 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:56 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc" returned: 0 in 0.617s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:56 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc Feb 27 22:24:56 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:56 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-45e53c38-b84e-47ee-8f97-119422c7b22a" returned: 0 in 0.542s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "cinder-quobyte-45e53c38-b84e-47ee-8f97-119422c7b22a" released by "delete_volume" :: held 1.260s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:56 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5dcaf73b-428e-46cb-bda6-d762053973bc" returned: 0 in 0.565s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG cinder.quota [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Created reservations ['a304b37d-2d3d-4008-a041-591a1e7dfa04', '284b8fac-c911-4076-b34f-ff4da9823103', '24586d6f-0f63-4933-9bdb-83cbba233740', '5861c162-6445-4437-971e-122ad2ba1bc5'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Lock "cinder-quobyte-5dcaf73b-428e-46cb-bda6-d762053973bc" released by "delete_volume" :: held 1.216s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Created reservations ['3676c103-c81c-4e38-8f51-b20ef6826c15', 'db0edea3-fa97-407f-a394-d359629baf1f', 'ad56b6bc-275d-4d69-96d7-cb593907346b', '47e664f5-f081-44a1-91e5-489ba60f07a9'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:56 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:56 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:56 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:56 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Acquiring lock "cinder-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Lock "cinder-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Acquiring lock "cinder-quobyte-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Lock "cinder-quobyte-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71" acquired by "delete_volume" :: waited 0.027s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab09719e-4cbf-4ae0-8fc2-8b8b41d73654]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:57 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 Feb 27 22:24:57 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:57 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-02024079-8299-44bb-ad42-e6ccae50dae9 req-c2cee945-afa1-44bd-b7ce-fa14d6292ada tempest-DeleteServersTestJSON-1248235940 None] Terminate volume connection completed successfully. Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-02024079-8299-44bb-ad42-e6ccae50dae9 req-c2cee945-afa1-44bd-b7ce-fa14d6292ada tempest-DeleteServersTestJSON-1248235940 None] Deleting attachment 935a9927-9c2d-49b5-94eb-54cc2995aca0. {{(pid=83540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5058}} Feb 27 22:24:57 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.499s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:57 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:57 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Deleted volume successfully. Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.604s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.manager [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:57 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Deleted volume successfully. Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1f0a401-7b27-45de-aac4-2f1dcd8282df tempest-VolumeQuotasAdminTestJSON-2058995067 None] Lock "cinder-5dcaf73b-428e-46cb-bda6-d762053973bc-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-bb5be3ad-4593-41ba-9124-69ee51117305 req-c03ce88d-ddcb-46f5-ba2e-c05da2f2bd9e tempest-ServerBootFromVolumeStableRescueTest-1243248328 None] Lock "cinder-45e53c38-b84e-47ee-8f97-119422c7b22a-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:57 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71" returned: 0 in 0.539s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:57 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71 Feb 27 22:24:57 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:58 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71" returned: 0 in 0.583s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Lock "cinder-quobyte-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71" released by "delete_volume" :: held 1.151s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Created reservations ['a1bff8a7-2ecc-47ae-a2a8-3dac82c8b450', 'a1f06965-09c3-4ede-9f15-e06c8437eb6b', '823b0fe3-74e0-4113-8574-3080cdbe6dfb', 'ce484c2e-fc49-4f77-a8d8-70e7aa59b953'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:24:58 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:24:58 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:24:58 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.546s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:24:58 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Deleted volume successfully. Feb 27 22:24:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-14672d53-4698-49a1-8502-5ce181276aea tempest-VolumesActionsTest-64622622 None] Lock "cinder-bcbfa234-0d82-43c7-bd1e-c52d8d78fa71-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Acquiring lock "cinder-f40c4103-0f11-4fd2-a65d-dc493a745286-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Lock "cinder-f40c4103-0f11-4fd2-a65d-dc493a745286-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=141,cinder:SELECT=117,cinder:INSERT=40,cinder:DELETE=18 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Acquiring lock "cinder-quobyte-f40c4103-0f11-4fd2-a65d-dc493a745286" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Lock "cinder-quobyte-f40c4103-0f11-4fd2-a65d-dc493a745286" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2087e6-b3d1-4726-9a77-8e2b734a026a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:02 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 Feb 27 22:25:02 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:02 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286" returned: 0 in 0.697s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:03 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286 Feb 27 22:25:03 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:03 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f40c4103-0f11-4fd2-a65d-dc493a745286" returned: 0 in 0.617s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Lock "cinder-quobyte-f40c4103-0f11-4fd2-a65d-dc493a745286" released by "delete_volume" :: held 1.353s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Created reservations ['99b15a31-3d5b-45f6-a087-dee44cebfa79', '03272b50-2820-4ecc-8d94-67cd7a517ba8', 'a7f72704-0d29-469a-b364-485128a4b761', 'ddaec932-8645-4b0f-b073-3cb4ad0342c8'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:03 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:03 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:04 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.523s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Deleted volume successfully. Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c0b38f70-38ba-4ace-80e0-c2612a45b48f tempest-DeleteServersTestJSON-1248235940 None] Lock "cinder-f40c4103-0f11-4fd2-a65d-dc493a745286-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Flow 'volume_create_manager' (fee5272f-3dbd-4ae9-bb71-97f03e136e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bf6ba5-74d4-4e3d-bcc6-a00e43bc428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bf6ba5-74d4-4e3d-bcc6-a00e43bc428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1152766247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b05e614-8c93-4af8-b597-f54b8eff4122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab886602cc2a47b9ac4ddaab2dbb0d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:05Z,use_quota=True,user_id='f1d5c2f55d604308841f0522f80453ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74632862-645b-4eb0-8a1e-638cf593dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74632862-645b-4eb0-8a1e-638cf593dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f5f22f-bf4b-4112-95ec-3c30cc3a1f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f5f22f-bf4b-4112-95ec-3c30cc3a1f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b05e614-8c93-4af8-b597-f54b8eff4122', 'volume_name': 'volume-1b05e614-8c93-4af8-b597-f54b8eff4122', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5949eb4-0161-49e5-af1d-6a730ef3936e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5949eb4-0161-49e5-af1d-6a730ef3936e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778c18c3-51f5-41e5-b189-1b9da4c5e192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:04 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Volume 1b05e614-8c93-4af8-b597-f54b8eff4122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b05e614-8c93-4af8-b597-f54b8eff4122', 'volume_size': 1} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1152766247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b05e614-8c93-4af8-b597-f54b8eff4122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab886602cc2a47b9ac4ddaab2dbb0d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:05Z,use_quota=True,user_id='f1d5c2f55d604308841f0522f80453ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Creating volume 1b05e614-8c93-4af8-b597-f54b8eff4122 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:04 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:04 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 1073741824 Feb 27 22:25:04 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:05 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 1073741824" returned: 0 in 0.661s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:05 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 Feb 27 22:25:05 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:06 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122" returned: 0 in 0.567s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778c18c3-51f5-41e5-b189-1b9da4c5e192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b05e614-8c93-4af8-b597-f54b8eff4122', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e63013a-92c4-48ba-9635-a94d3e3f7c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:06 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Volume volume-1b05e614-8c93-4af8-b597-f54b8eff4122 (1b05e614-8c93-4af8-b597-f54b8eff4122): created successfully Feb 27 22:25:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e63013a-92c4-48ba-9635-a94d3e3f7c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Flow 'volume_create_manager' (fee5272f-3dbd-4ae9-bb71-97f03e136e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:06 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f31df993-f469-4a2e-949c-8a3653d25add tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Created volume successfully. Feb 27 22:25:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Acquiring lock "cinder-1b05e614-8c93-4af8-b597-f54b8eff4122-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "cinder-1b05e614-8c93-4af8-b597-f54b8eff4122-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Acquiring lock "cinder-quobyte-1b05e614-8c93-4af8-b597-f54b8eff4122" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "cinder-quobyte-1b05e614-8c93-4af8-b597-f54b8eff4122" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:07 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb11e3-169a-44af-94f7-13472b804973]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:07 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 Feb 27 22:25:07 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:08 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122" returned: 0 in 0.793s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:08 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122 Feb 27 22:25:08 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:09 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1b05e614-8c93-4af8-b597-f54b8eff4122" returned: 0 in 0.578s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "cinder-quobyte-1b05e614-8c93-4af8-b597-f54b8eff4122" released by "delete_volume" :: held 1.427s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Created reservations ['66069e7a-8b9f-439c-ab5b-cb19902a12d5', '481c2fce-c5d0-408c-8157-703ede9de35e', '0c8eb5ea-3662-4f1d-a560-ade55484f476', 'be6f5d95-7be2-43e1-8b3c-46b2e4e3460f'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:09 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:09 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:09 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.513s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:09 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Deleted volume successfully. Feb 27 22:25:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a12684d-53c0-401f-9d6f-363e6c5084ee tempest-VolumeQuotasNegativeTestJSON-1672085164 None] Lock "cinder-1b05e614-8c93-4af8-b597-f54b8eff4122-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Flow 'volume_create_manager' (30beb5b0-9c3e-4bb5-9809-5eb8397bbf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ced5374-b124-4ed5-a934-a7ae41614315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ced5374-b124-4ed5-a934-a7ae41614315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-864568757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a5eebb-9f7c-406a-afc1-078b03c8de43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71205619ce7e4a5991927cd7d686f0aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:15Z,use_quota=True,user_id='f5e55e6616b64e01b209fc9d6bbed4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72250d80-c2c0-405e-91d6-5f9764a6cadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72250d80-c2c0-405e-91d6-5f9764a6cadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45404ab2-b04d-44f9-9fa3-9465b83e7e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45404ab2-b04d-44f9-9fa3-9465b83e7e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a5eebb-9f7c-406a-afc1-078b03c8de43', 'volume_name': 'volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b29561-3405-4096-9a67-ce4186f39bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b29561-3405-4096-9a67-ce4186f39bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9655a2-b781-41a5-9c43-b8c6aab57a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:14 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Volume d7a5eebb-9f7c-406a-afc1-078b03c8de43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43', 'volume_size': 1} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-864568757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a5eebb-9f7c-406a-afc1-078b03c8de43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71205619ce7e4a5991927cd7d686f0aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:15Z,use_quota=True,user_id='f5e55e6616b64e01b209fc9d6bbed4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Creating volume d7a5eebb-9f7c-406a-afc1-078b03c8de43 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:14 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:14 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 1073741824 Feb 27 22:25:14 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:15 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 1073741824" returned: 0 in 0.679s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:15 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 Feb 27 22:25:15 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:16 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43" returned: 0 in 0.600s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9655a2-b781-41a5-9c43-b8c6aab57a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3b0411-5ec2-4ecc-b004-f1900a9bf7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:16 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Volume volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 (d7a5eebb-9f7c-406a-afc1-078b03c8de43): created successfully Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3b0411-5ec2-4ecc-b004-f1900a9bf7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Flow 'volume_create_manager' (30beb5b0-9c3e-4bb5-9809-5eb8397bbf42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:16 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-d7a8fbc5-3f4f-413f-8cd8-12d9ce13565f req-fb87a17c-4354-45c6-ab70-05b3885a2675 tempest-VolumesSnapshotsTestJSON-1678084539 None] Created volume successfully. Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Flow 'volume_create_manager' (4d564c41-3254-4753-92ac-07dc06bd69ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e8ad5c-d712-4833-b8d2-a5e479b0f57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e8ad5c-d712-4833-b8d2-a5e479b0f57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2021991579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7249f375-7594-4510-a649-1b5cdbd416ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5e9ee6751d4fb08c2a9fe739a88273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:17Z,use_quota=True,user_id='8a20a9db884d4c048292dc9bcbdcb164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7963372a-8fc5-4a04-bb76-8583e22dd73c),volume_type_id=7963372a-8fc5-4a04-bb76-8583e22dd73c)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15db748d-50af-40a4-9b7c-070505c3a3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15db748d-50af-40a4-9b7c-070505c3a3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e28f273-7377-47d2-996c-565dd065a04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e28f273-7377-47d2-996c-565dd065a04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7249f375-7594-4510-a649-1b5cdbd416ad', 'volume_name': 'volume-7249f375-7594-4510-a649-1b5cdbd416ad', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59439038-b702-40e2-8e50-ee767d06422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59439038-b702-40e2-8e50-ee767d06422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51806aa5-6c6f-410f-8348-413afde038d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:16 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Volume 7249f375-7594-4510-a649-1b5cdbd416ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7249f375-7594-4510-a649-1b5cdbd416ad', 'volume_size': 1} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2021991579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7249f375-7594-4510-a649-1b5cdbd416ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5e9ee6751d4fb08c2a9fe739a88273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:17Z,use_quota=True,user_id='8a20a9db884d4c048292dc9bcbdcb164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7963372a-8fc5-4a04-bb76-8583e22dd73c),volume_type_id=7963372a-8fc5-4a04-bb76-8583e22dd73c)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Creating volume 7249f375-7594-4510-a649-1b5cdbd416ad {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:16 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:16 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad 1073741824 Feb 27 22:25:16 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:17 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-60365d35-e3de-48c9-b035-e8c9c8cc12a7 tempest-GroupSnapshotsV319Test-1130050563 None] Group tempest-GroupSnapshotsV319Test-Group-63807585: creating Feb 27 22:25:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:17 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-60365d35-e3de-48c9-b035-e8c9c8cc12a7 tempest-GroupSnapshotsV319Test-1130050563 None] Group tempest-GroupSnapshotsV319Test-Group-63807585: created successfully Feb 27 22:25:17 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-60365d35-e3de-48c9-b035-e8c9c8cc12a7 tempest-GroupSnapshotsV319Test-1130050563 None] Create group completed successfully. Feb 27 22:25:17 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad 1073741824" returned: 0 in 0.790s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:17 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad Feb 27 22:25:17 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:18 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad" returned: 0 in 0.616s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.895s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Creating offline snapshot 8eb675c9-5cc5-4393-a83b-5b1cd5f9104c of volume d7a5eebb-9f7c-406a-afc1-078b03c8de43 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51806aa5-6c6f-410f-8348-413afde038d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7249f375-7594-4510-a649-1b5cdbd416ad', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609cfe7e-15a2-44b4-8888-8afbbd3f93d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ba91a-8aca-4e24-b95d-a3f97125de9e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:18 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Volume volume-7249f375-7594-4510-a649-1b5cdbd416ad (7249f375-7594-4510-a649-1b5cdbd416ad): created successfully Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609cfe7e-15a2-44b4-8888-8afbbd3f93d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Flow 'volume_create_manager' (4d564c41-3254-4753-92ac-07dc06bd69ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:18 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6a548ecf-9b4b-4a47-98cb-6584697ca6b4 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Created volume successfully. Feb 27 22:25:18 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 Feb 27 22:25:18 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Flow 'volume_create_manager' (cbe2af3c-dab0-450d-9c22-d6cf0e78dd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1273b46-0eee-436f-86ad-21a0caad9335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1273b46-0eee-436f-86ad-21a0caad9335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531081603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=178c0b2f-b00d-488f-a415-4a91c1a2dce8,host='devstack@QuobyteHD#QuobyteHD',id=26fca319-707b-44ed-99f3-fc18407e9637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddf5055514d4ffeb66a8dd4428a65d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:19Z,use_quota=True,user_id='e9ba08880a2a4ad19e506a7a6158195c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85e19687-4f72-4719-a88d-9cb88b4f3929),volume_type_id=85e19687-4f72-4719-a88d-9cb88b4f3929)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10705c2-9dce-444e-8e3e-7a54bd7ec8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10705c2-9dce-444e-8e3e-7a54bd7ec8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b7b1a7-c1d0-4667-87b2-b6c3a3590bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b7b1a7-c1d0-4667-87b2-b6c3a3590bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fca319-707b-44ed-99f3-fc18407e9637', 'volume_name': 'volume-26fca319-707b-44ed-99f3-fc18407e9637', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e229f9-d810-49d7-b06e-7288802b052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e229f9-d810-49d7-b06e-7288802b052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba44930-136b-49d3-adb1-20ab3f2b849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:18 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Volume 26fca319-707b-44ed-99f3-fc18407e9637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fca319-707b-44ed-99f3-fc18407e9637', 'volume_size': 1} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:18 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43" returned: 0 in 0.707s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:18 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c 1G Feb 27 22:25:18 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:19 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:19 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:19 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c 1G" returned: 0 in 0.635s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:19 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c Feb 27 22:25:19 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:19 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.596s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:19 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:19 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-673baa5f-ec66-4ed6-9866-c43a1aed7e49 tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Retype volume completed successfully. Feb 27 22:25:20 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c" returned: 0 in 0.557s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:20 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c is being set with open permissions: ugo+rw Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:20 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c Feb 27 22:25:20 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Acquiring lock "cinder-7249f375-7594-4510-a649-1b5cdbd416ad-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "cinder-7249f375-7594-4510-a649-1b5cdbd416ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Acquiring lock "cinder-quobyte-7249f375-7594-4510-a649-1b5cdbd416ad" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "cinder-quobyte-7249f375-7594-4510-a649-1b5cdbd416ad" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b29c2b-1069-456b-bdd5-8150f617e7e6]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:20 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad Feb 27 22:25:20 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:20 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c" returned: 0 in 0.573s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:20 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.info Feb 27 22:25:20 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:21 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad" returned: 0 in 0.596s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:21 devstack sudo[86951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad Feb 27 22:25:21 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Flow 'volume_create_manager' (ed31f072-e210-4f6d-b12c-596865d475fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa3e123-81e0-424a-84c9-e7c0ab2ef264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa3e123-81e0-424a-84c9-e7c0ab2ef264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1681384442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135c59c7-400d-4225-a1a8-a99f09b44065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eb40e371a44f1ab9998f1a9e2efd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:21Z,use_quota=True,user_id='39bafa9aaa384dae936ae56b0578dd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef1a6c1-2e87-416a-a4e0-b64c7ecf9b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef1a6c1-2e87-416a-a4e0-b64c7ecf9b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd156751-7b93-4e0c-9df4-a7a9a4ccb8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd156751-7b93-4e0c-9df4-a7a9a4ccb8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '135c59c7-400d-4225-a1a8-a99f09b44065', 'volume_name': 'volume-135c59c7-400d-4225-a1a8-a99f09b44065', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe273c9-53ba-49b2-a476-9f8d380ae225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe273c9-53ba-49b2-a476-9f8d380ae225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5399280f-d18a-4850-821c-ed3534db798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:21 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Volume 135c59c7-400d-4225-a1a8-a99f09b44065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-135c59c7-400d-4225-a1a8-a99f09b44065', 'volume_size': 1} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:21 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.info" returned: 0 in 0.567s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:21 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.info is being set with open permissions: ugo+rw Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:21 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.info Feb 27 22:25:21 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:21 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7249f375-7594-4510-a649-1b5cdbd416ad" returned: 0 in 0.454s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "cinder-quobyte-7249f375-7594-4510-a649-1b5cdbd416ad" released by "delete_volume" :: held 1.088s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:21 devstack cinder-volume[83540]: WARNING cinder.quota [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:25:21 devstack cinder-volume[83540]: WARNING cinder.quota [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Created reservations ['20d5135a-d611-430e-9cdc-e3f304878fca', '05a7e7ec-c480-4d99-9dc1-494aadc3c482', '68c6866c-587b-4585-bac5-78a2ce72a215', 'fc3477ae-e0fd-4abd-8175-77e14ee95356'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:21 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:21 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:21 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.info" returned: 0 in 0.484s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.615s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.917s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=178c0b2f-b00d-488f-a415-4a91c1a2dce8,created_at=2026-02-27T21:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531081603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=178c0b2f-b00d-488f-a415-4a91c1a2dce8,host='devstack@QuobyteHD#QuobyteHD',id=26fca319-707b-44ed-99f3-fc18407e9637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddf5055514d4ffeb66a8dd4428a65d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:19Z,use_quota=True,user_id='e9ba08880a2a4ad19e506a7a6158195c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85e19687-4f72-4719-a88d-9cb88b4f3929),volume_type_id=85e19687-4f72-4719-a88d-9cb88b4f3929)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Creating volume 26fca319-707b-44ed-99f3-fc18407e9637 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:21 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:21 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-05a9108a-7ee2-47b6-9614-94c23f03ce62 req-5f93cdc5-49dc-4f11-b922-53a2a66d1333 tempest-VolumesSnapshotsTestJSON-1678084539 None] Create snapshot completed successfully Feb 27 22:25:21 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 1073741824 Feb 27 22:25:21 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:22 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.497s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:22 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Deleted volume successfully. Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8adf48d6-4d6d-41e3-8035-9e59c841dbfc tempest-VolumeRetypeWithoutMigrationTest-592917948 None] Lock "cinder-7249f375-7594-4510-a649-1b5cdbd416ad-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:22 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 1073741824" returned: 0 in 0.599s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:22 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 Feb 27 22:25:22 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:22 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637" returned: 0 in 0.500s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1681384442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135c59c7-400d-4225-a1a8-a99f09b44065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62eb40e371a44f1ab9998f1a9e2efd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:21Z,use_quota=True,user_id='39bafa9aaa384dae936ae56b0578dd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Creating volume 135c59c7-400d-4225-a1a8-a99f09b44065 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:22 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "cinder-8eb675c9-5cc5-4393-a83b-5b1cd5f9104c-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:22 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 1073741824 Feb 27 22:25:22 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba44930-136b-49d3-adb1-20ab3f2b849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fca319-707b-44ed-99f3-fc18407e9637', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ae5774-4946-4950-b028-6dfc837d2070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-8eb675c9-5cc5-4393-a83b-5b1cd5f9104c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "cinder-quobyte-d7a5eebb-9f7c-406a-afc1-078b03c8de43" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:22 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Volume volume-26fca319-707b-44ed-99f3-fc18407e9637 (26fca319-707b-44ed-99f3-fc18407e9637): created successfully Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ae5774-4946-4950-b028-6dfc837d2070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Flow 'volume_create_manager' (cbe2af3c-dab0-450d-9c22-d6cf0e78dd8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:23 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-068330e0-19ae-44b9-b9ea-977dcb6156b0 tempest-GroupSnapshotsV319Test-1130050563 None] Created volume successfully. Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-quobyte-d7a5eebb-9f7c-406a-afc1-078b03c8de43" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "cinder-quobyte-8eb675c9-5cc5-4393-a83b-5b1cd5f9104c" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-quobyte-8eb675c9-5cc5-4393-a83b-5b1cd5f9104c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Deleting offline snapshot 8eb675c9-5cc5-4393-a83b-5b1cd5f9104c of volume d7a5eebb-9f7c-406a-afc1-078b03c8de43 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] snapshot_file for this snap is: volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1282f6f-db08-4812-9705-c2b0e6df4215]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:23 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c Feb 27 22:25:23 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:23 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 1073741824" returned: 0 in 0.686s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:23 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 Feb 27 22:25:23 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:23 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c" returned: 0 in 0.670s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa5666-0a60-4657-b25f-36aa8898afd7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:23 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 Feb 27 22:25:23 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:24 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065" returned: 0 in 0.560s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5399280f-d18a-4850-821c-ed3534db798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135c59c7-400d-4225-a1a8-a99f09b44065', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1734be8-3c6c-42d0-a3b3-cf4e1241b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:24 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Volume volume-135c59c7-400d-4225-a1a8-a99f09b44065 (135c59c7-400d-4225-a1a8-a99f09b44065): created successfully Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1734be8-3c6c-42d0-a3b3-cf4e1241b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Flow 'volume_create_manager' (ed31f072-e210-4f6d-b12c-596865d475fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:24 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-371b0f6f-a430-4469-93e1-69a93ba81ac6 tempest-AbsoluteLimitsTests-462718780 None] Created volume successfully. Feb 27 22:25:24 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] GroupSnapshot 622bb24b-1064-4a6c-a128-3c66e7076c0d: creating. Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Group snapshot 622bb24b-1064-4a6c-a128-3c66e7076c0d: creating. {{(pid=83540) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4178}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Creating offline snapshot 69941beb-e292-4d41-b3ba-811350a5e85e of volume 26fca319-707b-44ed-99f3-fc18407e9637 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2192238d-a670-4d56-9ebd-5275f5699229]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:24 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43" returned: 0 in 0.732s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:24 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 Feb 27 22:25:24 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:24 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c Feb 27 22:25:24 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:25 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637" returned: 0 in 0.652s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:25 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e 1G Feb 27 22:25:25 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:25 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c" returned: 0 in 0.667s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:25 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c Feb 27 22:25:25 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Acquiring lock "cinder-135c59c7-400d-4225-a1a8-a99f09b44065-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Lock "cinder-135c59c7-400d-4225-a1a8-a99f09b44065-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Acquiring lock "cinder-quobyte-135c59c7-400d-4225-a1a8-a99f09b44065" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Lock "cinder-quobyte-135c59c7-400d-4225-a1a8-a99f09b44065" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e54bbc-2c9c-42b1-9bc5-627cfc94fb54]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:25 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e 1G" returned: 0 in 0.623s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fca319-707b-44ed-99f3-fc18407e9637 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:25 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fca319-707b-44ed-99f3-fc18407e9637 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e Feb 27 22:25:25 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:25 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43.8eb675c9-5cc5-4393-a83b-5b1cd5f9104c" returned: 0 in 0.614s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:25 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 Feb 27 22:25:25 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-quobyte-8eb675c9-5cc5-4393-a83b-5b1cd5f9104c" released by "_delete_snapshot" :: held 2.770s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-quobyte-d7a5eebb-9f7c-406a-afc1-078b03c8de43" released by "delete_snapshot" :: held 2.786s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:25 devstack cinder-volume[83540]: WARNING cinder.quota [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG cinder.quota [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Created reservations ['b621f9c6-550d-4288-a7a0-c88bb19d1674', 'ca998a25-45a1-4847-affb-91390cb7f260', '1768cce1-4431-4049-8d75-f58f60e9c2c6', '7c7d5280-59d8-429a-a392-ba143ac9c7ba'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:25 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Delete snapshot completed successfully. Feb 27 22:25:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-70ffa16d-665a-4a6c-9847-0ab49a057d00 req-7fbbdf1e-b02d-49b2-81d7-4973c55b6803 tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-8eb675c9-5cc5-4393-a83b-5b1cd5f9104c-delete_snapshot" released by "delete_snapshot" :: held 2.962s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "cinder-d7a5eebb-9f7c-406a-afc1-078b03c8de43-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-d7a5eebb-9f7c-406a-afc1-078b03c8de43-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "cinder-quobyte-d7a5eebb-9f7c-406a-afc1-078b03c8de43" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-quobyte-d7a5eebb-9f7c-406a-afc1-078b03c8de43" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:26 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9699c886-64d6-48d4-938e-7e6fc39cf51c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065" returned: 0 in 0.602s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:26 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065 Feb 27 22:25:26 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:26 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fca319-707b-44ed-99f3-fc18407e9637 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e" returned: 0 in 0.668s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:26 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:26 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 Feb 27 22:25:26 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:26 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e Feb 27 22:25:26 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:26 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-135c59c7-400d-4225-a1a8-a99f09b44065" returned: 0 in 0.605s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:26 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Lock "cinder-quobyte-135c59c7-400d-4225-a1a8-a99f09b44065" released by "delete_volume" :: held 1.260s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e" returned: 0 in 0.547s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:26 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43" returned: 0 in 0.693s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:26 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.info Feb 27 22:25:26 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:26 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43 Feb 27 22:25:26 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:26 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Created reservations ['352c3bfc-899f-4ea2-9e88-ea454336ee8a', '34a97d50-9326-47a7-b6d3-2b811fe5409a', 'fb36f54d-68ab-4a6a-87fd-259ed212cf97', '9546bab4-5b6b-410a-b1c3-9381d849fc6d'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:27 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:27 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:27 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d7a5eebb-9f7c-406a-afc1-078b03c8de43" returned: 0 in 0.517s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-quobyte-d7a5eebb-9f7c-406a-afc1-078b03c8de43" released by "delete_volume" :: held 1.250s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG cinder.quota [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Created reservations ['bddd5314-0847-44f9-8846-c2f3a5ea232e', 'e94f3297-77fc-48cf-aebb-89b628876234', '4e8097d6-9987-4f82-ab3d-21e1b738c09b', 'f672a8f2-9ab5-4dfb-bc9f-1a409777caa5'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:27 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.info" returned: 0 in 0.636s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:27 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:27 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:27 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.info Feb 27 22:25:27 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.579s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:27 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Deleted volume successfully. Feb 27 22:25:27 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:27 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-023e111b-c82e-457e-8ded-604179b29ad8 tempest-AbsoluteLimitsTests-462718780 None] Lock "cinder-135c59c7-400d-4225-a1a8-a99f09b44065-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:28 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.info" returned: 0 in 0.583s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.781s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:28 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.603s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:28 devstack cinder-volume[83540]: DEBUG cinder.manager [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:28 devstack cinder-volume[83540]: INFO cinder.volume.manager [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Deleted volume successfully. Feb 27 22:25:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [req-8482f96b-9861-41c3-b6ce-21d33bde4085 req-305e8b67-b6a9-4839-a5b4-1cfc4788214a tempest-VolumesSnapshotsTestJSON-1678084539 None] Lock "cinder-d7a5eebb-9f7c-406a-afc1-078b03c8de43-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:28 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ca28e748-21d5-40dc-9923-c3c76f78f1a0 tempest-GroupSnapshotsV319Test-1130050563 None] group_snapshot 622bb24b-1064-4a6c-a128-3c66e7076c0d: created successfully Feb 27 22:25:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] group_snapshot 622bb24b-1064-4a6c-a128-3c66e7076c0d: deleting Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] group_snapshot 622bb24b-1064-4a6c-a128-3c66e7076c0d: deleting {{(pid=83540) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4353}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Acquiring lock "cinder-quobyte-26fca319-707b-44ed-99f3-fc18407e9637" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Lock "cinder-quobyte-26fca319-707b-44ed-99f3-fc18407e9637" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Acquiring lock "cinder-quobyte-69941beb-e292-4d41-b3ba-811350a5e85e" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Lock "cinder-quobyte-69941beb-e292-4d41-b3ba-811350a5e85e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Deleting offline snapshot 69941beb-e292-4d41-b3ba-811350a5e85e of volume 26fca319-707b-44ed-99f3-fc18407e9637 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] snapshot_file for this snap is: volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4e1850-0934-4199-acb6-cd9a773887e7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:29 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e Feb 27 22:25:29 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:29 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e" returned: 0 in 0.759s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26fca319-707b-44ed-99f3-fc18407e9637(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc7b057-a7b6-4e21-9c4f-ed00e0d2f30a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:30 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 Feb 27 22:25:30 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:30 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637" returned: 0 in 0.702s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:30 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e Feb 27 22:25:30 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:31 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e" returned: 0 in 0.624s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:31 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e Feb 27 22:25:31 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=139,cinder:UPDATE=181,cinder:INSERT=42,cinder:DELETE=11 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Flow 'volume_create_manager' (fd95c579-6fcb-44cd-8e97-5b19db1acd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb9ab54-5297-487d-ae47-d3f97653d812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb9ab54-5297-487d-ae47-d3f97653d812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1402216705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2aea12-d77d-41a6-b19d-7d74a3906bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27adb2c6ff04fc284818ede1dbf99f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:32Z,use_quota=True,user_id='819fb34edff7466cabee7283bd4ca576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbe18e9-ac20-4bf5-b881-5b38c7912cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbe18e9-ac20-4bf5-b881-5b38c7912cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f916ab65-96e3-4e92-bf83-40a114da36af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f916ab65-96e3-4e92-bf83-40a114da36af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2aea12-d77d-41a6-b19d-7d74a3906bef', 'volume_name': 'volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fa6a4e-abbb-4388-81f2-fd2980deb2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fa6a4e-abbb-4388-81f2-fd2980deb2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efc07e9-7f8d-4fd6-a77c-d495cb4ba0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:31 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Volume fb2aea12-d77d-41a6-b19d-7d74a3906bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef', 'volume_size': 1} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1402216705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2aea12-d77d-41a6-b19d-7d74a3906bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27adb2c6ff04fc284818ede1dbf99f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:32Z,use_quota=True,user_id='819fb34edff7466cabee7283bd4ca576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Creating volume fb2aea12-d77d-41a6-b19d-7d74a3906bef {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:31 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:31 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637.69941beb-e292-4d41-b3ba-811350a5e85e" returned: 0 in 0.653s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:31 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef 1073741824 Feb 27 22:25:31 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Lock "cinder-quobyte-69941beb-e292-4d41-b3ba-811350a5e85e" released by "_delete_snapshot" :: held 2.837s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Lock "cinder-quobyte-26fca319-707b-44ed-99f3-fc18407e9637" released by "delete_snapshot" :: held 2.853s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:32 devstack cinder-volume[83540]: WARNING cinder.quota [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1234262212 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1234262212, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:25:32 devstack cinder-volume[83540]: WARNING cinder.quota [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1234262212 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1234262212, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] Created reservations ['61167430-ce9f-47ef-9eca-f99e7160ad57', '19517dde-d28f-4bf2-9d08-35b5b59f468f', 'c29e98e6-3ced-4794-a9ff-221fceb51dac', '057b63e8-ed48-4d32-a4ec-8a1da30169b9'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:32 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ed2214c0-cc1c-42c5-9733-d9353faccf7d tempest-GroupSnapshotsV319Test-1130050563 None] group_snapshot 622bb24b-1064-4a6c-a128-3c66e7076c0d: deleted successfully Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Flow 'volume_create_manager' (00773dc4-6182-4d52-a2bb-7a24ee67ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b54471-d341-4037-a1ca-29bc87bba38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b54471-d341-4037-a1ca-29bc87bba38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-18661799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360188af-9566-42d1-bd52-b6c91beea80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a3c9f8a854bb282e8ebb2e27d1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:32Z,use_quota=True,user_id='624a8f8466d54e68b2d3b56944e1e346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fd693f-5544-483e-805c-c1d904fb13a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fd693f-5544-483e-805c-c1d904fb13a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fe289a-a0ba-416e-98ae-d64029c4abf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fe289a-a0ba-416e-98ae-d64029c4abf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360188af-9566-42d1-bd52-b6c91beea80b', 'volume_name': 'volume-360188af-9566-42d1-bd52-b6c91beea80b', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b28ce6-a994-4932-b1f2-d75b0886e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b28ce6-a994-4932-b1f2-d75b0886e76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8161620-7298-45da-82ce-2dca094a1a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:32 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Volume 360188af-9566-42d1-bd52-b6c91beea80b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360188af-9566-42d1-bd52-b6c91beea80b', 'volume_size': 1} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:32 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef 1073741824" returned: 0 in 0.668s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Acquiring lock "cinder-quobyte-26fca319-707b-44ed-99f3-fc18407e9637" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Lock "cinder-quobyte-26fca319-707b-44ed-99f3-fc18407e9637" acquired by "delete_volume" :: waited 0.024s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:32 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef Feb 27 22:25:32 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a1b0ca-73de-49d4-90b0-8439dac53bd7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:32 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 Feb 27 22:25:32 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:33 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef" returned: 0 in 0.459s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.832s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-18661799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360188af-9566-42d1-bd52-b6c91beea80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a3c9f8a854bb282e8ebb2e27d1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:32Z,use_quota=True,user_id='624a8f8466d54e68b2d3b56944e1e346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Creating volume 360188af-9566-42d1-bd52-b6c91beea80b {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:33 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efc07e9-7f8d-4fd6-a77c-d495cb4ba0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:33 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b 1073741824 Feb 27 22:25:33 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174c4b60-90a8-4689-bef8-2dfa66eadf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:33 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Volume volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef (fb2aea12-d77d-41a6-b19d-7d74a3906bef): created successfully Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174c4b60-90a8-4689-bef8-2dfa66eadf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Flow 'volume_create_manager' (fd95c579-6fcb-44cd-8e97-5b19db1acd95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6d893ff9-4817-4891-9bdf-eb80ee3d4475 tempest-VolumesMetadataTest-691306858 None] Created volume successfully. Feb 27 22:25:33 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637" returned: 0 in 0.542s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:33 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637 Feb 27 22:25:33 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e27ca96b-a625-40e9-8fd3-1bf830919687 tempest-BackendsCapabilitiesAdminTestsJSON-764647340 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5844268798828, 'free_capacity_gb': 1775.5844268798828, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83540) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4833}} Feb 27 22:25:33 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-26fca319-707b-44ed-99f3-fc18407e9637" returned: 0 in 0.473s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:33 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b 1073741824" returned: 0 in 0.612s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Lock "cinder-quobyte-26fca319-707b-44ed-99f3-fc18407e9637" released by "delete_volume" :: held 1.074s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Created reservations ['f0080ad0-2f0e-4884-b067-3d8960fe03c6'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:33 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b Feb 27 22:25:33 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:33 devstack cinder-volume[83540]: WARNING cinder.quota [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1234262212 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1234262212, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Created reservations ['454a6e77-0686-4a76-a829-7d07fb949072', 'ea023e0d-2993-4287-a0b2-2824d4e41096', '2c2e569f-0f29-4291-b5a4-3efa243af8d5', 'd1231103-484c-4a86-b51c-eaa370fdad3a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:33 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:33 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fea52217-ce02-49fe-b12e-7b23c5b39a95 tempest-BackendsCapabilitiesAdminTestsJSON-764647340 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5844268798828, 'free_capacity_gb': 1775.5844268798828, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83540) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4833}} Feb 27 22:25:34 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b" returned: 0 in 0.514s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8161620-7298-45da-82ce-2dca094a1a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360188af-9566-42d1-bd52-b6c91beea80b', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5782bd6c-9712-4947-bafe-49e94490ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:34 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Volume volume-360188af-9566-42d1-bd52-b6c91beea80b (360188af-9566-42d1-bd52-b6c91beea80b): created successfully Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5782bd6c-9712-4947-bafe-49e94490ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Flow 'volume_create_manager' (00773dc4-6182-4d52-a2bb-7a24ee67ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:34 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-75a6da44-ac0c-47f4-9d35-ba49f0f5e5c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Created volume successfully. Feb 27 22:25:34 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.582s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:34 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d17e2d02-8a4e-47e3-9ed7-40c332ad6acd tempest-GroupSnapshotsV319Test-1130050563 None] Delete group completed successfully. Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Acquiring lock "cinder-fb2aea12-d77d-41a6-b19d-7d74a3906bef-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Lock "cinder-fb2aea12-d77d-41a6-b19d-7d74a3906bef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Acquiring lock "cinder-quobyte-fb2aea12-d77d-41a6-b19d-7d74a3906bef" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Lock "cinder-quobyte-fb2aea12-d77d-41a6-b19d-7d74a3906bef" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fe2aca-a1fe-4b64-9818-689b82e17539]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:34 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef Feb 27 22:25:34 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:35 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef" returned: 0 in 0.606s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:35 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef Feb 27 22:25:35 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Creating offline snapshot 4cdb600c-3746-4c40-95d1-e2891da6ca72 of volume 360188af-9566-42d1-bd52-b6c91beea80b {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7647de2f-baeb-4a88-b77d-d92faed47e26]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:35 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b Feb 27 22:25:35 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:35 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fb2aea12-d77d-41a6-b19d-7d74a3906bef" returned: 0 in 0.595s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Lock "cinder-quobyte-fb2aea12-d77d-41a6-b19d-7d74a3906bef" released by "delete_volume" :: held 1.230s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Created reservations ['e7f80a09-3926-44df-af43-fd8d6be0f715', '4883a11c-09ae-4843-b8b2-8b07fbced9f9', '3270abf3-72df-4db8-8a38-f9548ab4f8c5', 'd3516119-d626-43f6-bd47-f8ea99c1bc5e'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:36 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:36 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:36 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b" returned: 0 in 0.726s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:36 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 1G Feb 27 22:25:36 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:36 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.771s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:36 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:36 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Deleted volume successfully. Feb 27 22:25:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-11cfb476-61ba-480a-8efb-47417e32cf52 tempest-VolumesMetadataTest-691306858 None] Lock "cinder-fb2aea12-d77d-41a6-b19d-7d74a3906bef-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:37 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 1G" returned: 0 in 0.722s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360188af-9566-42d1-bd52-b6c91beea80b -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:37 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360188af-9566-42d1-bd52-b6c91beea80b -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 Feb 27 22:25:37 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:37 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360188af-9566-42d1-bd52-b6c91beea80b -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72" returned: 0 in 0.801s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:37 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 is being set with open permissions: ugo+rw Feb 27 22:25:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:37 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 Feb 27 22:25:37 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:38 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72" returned: 0 in 0.611s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:38 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.info Feb 27 22:25:38 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:38 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1c16eb49-a2b0-4448-a40a-bd2b4f35834f tempest-GroupSnapshotsTest-1553791753 None] Group tempest-GroupSnapshotsTest-Group-1701587973: creating Feb 27 22:25:38 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1c16eb49-a2b0-4448-a40a-bd2b4f35834f tempest-GroupSnapshotsTest-1553791753 None] Group tempest-GroupSnapshotsTest-Group-1701587973: created successfully Feb 27 22:25:38 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1c16eb49-a2b0-4448-a40a-bd2b4f35834f tempest-GroupSnapshotsTest-1553791753 None] Create group completed successfully. Feb 27 22:25:39 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.info" returned: 0 in 0.691s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:39 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.info is being set with open permissions: ugo+rw Feb 27 22:25:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:39 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.info Feb 27 22:25:39 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:39 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.info" returned: 0 in 0.619s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:39 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-aefcd762-4d11-460d-a895-a279567d5021 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Create snapshot completed successfully Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Flow 'volume_create_manager' (bc5d1ab0-2ae5-4150-9fd7-552170dcd93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b915e8a8-bc29-49ea-ac6e-d3890e6cbf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b915e8a8-bc29-49ea-ac6e-d3890e6cbf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-601051899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=211e2a5a-c774-4d1a-af4f-ae9a341e5819,host='devstack@QuobyteHD#QuobyteHD',id=0e0c5f52-0989-44b4-951a-3df0f5af5bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b7d911867f405386dcff0d413815e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:40Z,use_quota=True,user_id='225f0633c14d49c0884c90eb91e70560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(250a51f6-27bf-481d-9dd7-42a1306d278f),volume_type_id=250a51f6-27bf-481d-9dd7-42a1306d278f)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f684ba-97ef-4238-b31b-b19f7ee05813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f684ba-97ef-4238-b31b-b19f7ee05813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619d5faf-2f64-4d99-9fde-61690c4855a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619d5faf-2f64-4d99-9fde-61690c4855a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0c5f52-0989-44b4-951a-3df0f5af5bd9', 'volume_name': 'volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa22937-f7d3-4a3b-8038-e8755b989cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa22937-f7d3-4a3b-8038-e8755b989cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca121f3c-6026-4b44-8650-8d2e001d9eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:40 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Volume 0e0c5f52-0989-44b4-951a-3df0f5af5bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9', 'volume_size': 1} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=211e2a5a-c774-4d1a-af4f-ae9a341e5819,created_at=2026-02-27T21:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-601051899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=211e2a5a-c774-4d1a-af4f-ae9a341e5819,host='devstack@QuobyteHD#QuobyteHD',id=0e0c5f52-0989-44b4-951a-3df0f5af5bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b7d911867f405386dcff0d413815e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:40Z,use_quota=True,user_id='225f0633c14d49c0884c90eb91e70560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(250a51f6-27bf-481d-9dd7-42a1306d278f),volume_type_id=250a51f6-27bf-481d-9dd7-42a1306d278f)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Creating volume 0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:40 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:40 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 1073741824 Feb 27 22:25:40 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:40 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:40 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:41 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 1073741824" returned: 0 in 0.874s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:41 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 Feb 27 22:25:41 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Flow 'volume_create_manager' (ad8e1be2-035f-424e-b443-c934c0771783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b60ee6-6014-46d7-80e4-b765765bdaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b60ee6-6014-46d7-80e4-b765765bdaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1310202756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1ba1ae-9434-4bde-a7fa-9f0083f227b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13283f8550e4774a9bcb2b49ff1bb10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:41Z,use_quota=True,user_id='7662e2e099014783a38e3aab67596f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93a4391-ba25-4298-8d14-0d904ae1a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93a4391-ba25-4298-8d14-0d904ae1a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03e31d6-e6af-4692-bcdd-ded1f875a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03e31d6-e6af-4692-bcdd-ded1f875a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a1ba1ae-9434-4bde-a7fa-9f0083f227b7', 'volume_name': 'volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bf4ae4-deca-454d-960d-d39112ed24b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bf4ae4-deca-454d-960d-d39112ed24b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebd0aee-63ba-497a-846f-a6127c74c4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:41 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Volume 5a1ba1ae-9434-4bde-a7fa-9f0083f227b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7', 'volume_size': 1} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "cinder-4cdb600c-3746-4c40-95d1-e2891da6ca72-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-4cdb600c-3746-4c40-95d1-e2891da6ca72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "cinder-quobyte-360188af-9566-42d1-bd52-b6c91beea80b" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-quobyte-360188af-9566-42d1-bd52-b6c91beea80b" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "cinder-quobyte-4cdb600c-3746-4c40-95d1-e2891da6ca72" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-quobyte-4cdb600c-3746-4c40-95d1-e2891da6ca72" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Deleting offline snapshot 4cdb600c-3746-4c40-95d1-e2891da6ca72 of volume 360188af-9566-42d1-bd52-b6c91beea80b {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] snapshot_file for this snap is: volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b893e9a-7062-43cf-904f-d742cfde1e4e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:41 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.670s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:25:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:25:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:25:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:25:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:25:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:25:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:25:41 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 Feb 27 22:25:41 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:41 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" returned: 0 in 0.646s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.389s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1310202756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1ba1ae-9434-4bde-a7fa-9f0083f227b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13283f8550e4774a9bcb2b49ff1bb10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:41Z,use_quota=True,user_id='7662e2e099014783a38e3aab67596f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Creating volume 5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:41 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca121f3c-6026-4b44-8650-8d2e001d9eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:41 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 1073741824 Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eb5af4-7621-4aad-bf62-6feea2684e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:41 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:41 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Volume volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 (0e0c5f52-0989-44b4-951a-3df0f5af5bd9): created successfully Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eb5af4-7621-4aad-bf62-6feea2684e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Flow 'volume_create_manager' (bc5d1ab0-2ae5-4150-9fd7-552170dcd93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:41 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-75fff684-1eb4-4971-b582-61186f9b76e0 tempest-GroupSnapshotsTest-1553791753 None] Created volume successfully. Feb 27 22:25:42 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72" returned: 0 in 0.635s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-360188af-9566-42d1-bd52-b6c91beea80b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec9809-7e1a-4376-8159-9ed8185962dc]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:42 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b Feb 27 22:25:42 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:42 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 1073741824" returned: 0 in 0.668s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:42 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 Feb 27 22:25:42 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] GroupSnapshot 3b44a956-8a0e-406b-860f-3918d7723fcf: creating. Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Group snapshot 3b44a956-8a0e-406b-860f-3918d7723fcf: creating. {{(pid=83540) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4178}} Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:42 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b" returned: 0 in 0.642s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:42 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 Feb 27 22:25:42 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:43 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7" returned: 0 in 0.556s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.470s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Creating offline snapshot 55ac5fea-ee87-477f-9269-7df547f295f2 of volume 0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebd0aee-63ba-497a-846f-a6127c74c4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d3dcfd-679d-411b-b968-9cfdd31ea266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3511b212-c2ce-4044-8d32-2a48584495f5]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:43 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Volume volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 (5a1ba1ae-9434-4bde-a7fa-9f0083f227b7): created successfully Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d3dcfd-679d-411b-b968-9cfdd31ea266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Flow 'volume_create_manager' (ad8e1be2-035f-424e-b443-c934c0771783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:43 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c6ee4f0d-4b34-4a03-bee1-c7271de950af tempest-VolumesTransfersV355Test-1475626731 None] Created volume successfully. Feb 27 22:25:43 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 Feb 27 22:25:43 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:43 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72" returned: 0 in 0.615s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:43 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72 Feb 27 22:25:43 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:43 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" returned: 0 in 0.745s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:43 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 1G Feb 27 22:25:43 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-713bbde9-39e6-4ecc-b977-9d57a044c719 tempest-VolumesTransfersV355Test-208429389 None] Transfer volume completed successfully. Feb 27 22:25:44 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b.4cdb600c-3746-4c40-95d1-e2891da6ca72" returned: 0 in 0.601s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-quobyte-4cdb600c-3746-4c40-95d1-e2891da6ca72" released by "_delete_snapshot" :: held 2.573s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-quobyte-360188af-9566-42d1-bd52-b6c91beea80b" released by "delete_snapshot" :: held 2.590s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Created reservations ['284b8523-817e-4a03-a94f-83d7287b57a3', '09403109-4e40-4f0d-a62b-2a5c0e7bdd98', '2b692fd9-60c1-49ba-9bfc-e81339384d72', '7ec8fb5c-af62-426e-b990-9e0e9e6bc734'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Delete snapshot completed successfully. Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de8ecf4d-c038-4b02-b4e8-0dd4fc0812e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-4cdb600c-3746-4c40-95d1-e2891da6ca72-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4f6f2108-5cd6-4a7f-ad9e-c6f3b00a9973 tempest-GroupsV320Test-1672504132 None] Group tempest-GroupsV320Test-Group-51254696: creating Feb 27 22:25:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4f6f2108-5cd6-4a7f-ad9e-c6f3b00a9973 tempest-GroupsV320Test-1672504132 None] Group tempest-GroupsV320Test-Group-51254696: created successfully Feb 27 22:25:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4f6f2108-5cd6-4a7f-ad9e-c6f3b00a9973 tempest-GroupsV320Test-1672504132 None] Create group completed successfully. Feb 27 22:25:44 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 1G" returned: 0 in 0.731s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:44 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 Feb 27 22:25:44 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "cinder-360188af-9566-42d1-bd52-b6c91beea80b-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-360188af-9566-42d1-bd52-b6c91beea80b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "cinder-quobyte-360188af-9566-42d1-bd52-b6c91beea80b" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-quobyte-360188af-9566-42d1-bd52-b6c91beea80b" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d93e403-459c-4254-9dee-301412206612]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:44 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b Feb 27 22:25:44 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Acquiring lock "cinder-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Lock "cinder-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Acquiring lock "cinder-quobyte-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Lock "cinder-quobyte-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7deff9-0f8e-4737-924b-7021f8996b00]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:45 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 Feb 27 22:25:45 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:45 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2" returned: 0 in 0.577s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:45 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:45 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 Feb 27 22:25:45 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:45 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b" returned: 0 in 0.584s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:45 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b Feb 27 22:25:45 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:45 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2" returned: 0 in 0.491s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:45 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.info Feb 27 22:25:45 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:45 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7" returned: 0 in 0.678s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:45 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7 Feb 27 22:25:45 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Created reservations ['67d1abf2-c3e6-43f9-82e1-7e302b9954eb'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:45 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-360188af-9566-42d1-bd52-b6c91beea80b" returned: 0 in 0.582s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:45 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:45 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-quobyte-360188af-9566-42d1-bd52-b6c91beea80b" released by "delete_volume" :: held 1.220s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Created reservations ['aae69f88-5b14-4ecd-a678-b0c48a121b11', '41497d36-fbbb-4f3b-a600-09f80cabbd8a', 'ada12374-b39c-42dd-8a5d-18b6821d92cd', '6fa9b30f-4acf-48ca-9c76-3f0381bb0aa1'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:46 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:46 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:46 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.info" returned: 0 in 0.545s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:46 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:46 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.info Feb 27 22:25:46 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:46 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7" returned: 0 in 0.515s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Lock "cinder-quobyte-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7" released by "delete_volume" :: held 1.227s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Created reservations ['506d9a3c-d307-4816-8de1-4a06dfb32b64', '2c86a1ca-02f7-4ec3-88d6-e02a0df7fc46', '9d1124aa-a16f-42d3-b997-c31103799c24', '56b77729-b9cd-4b1a-99b2-e2245d409a05'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:46 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:46 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:46 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.580s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-02e2ed19-651d-4f22-bc0b-d2bcb0fa9f16 tempest-GroupsV320Test-1672504132 None] Delete group completed successfully. Feb 27 22:25:46 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.466s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Deleted volume successfully. Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0b7a9779-7ccd-4ac5-9b8e-9a7d3cc578e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2121128092 None] Lock "cinder-360188af-9566-42d1-bd52-b6c91beea80b-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:46 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.info" returned: 0 in 0.487s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.665s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8109bba1-9cbd-4f62-a8b8-cc938ee904c9 tempest-GroupSnapshotsTest-1553791753 None] group_snapshot 3b44a956-8a0e-406b-860f-3918d7723fcf: created successfully Feb 27 22:25:46 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Deleted volume successfully. Feb 27 22:25:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4acc6cad-b788-4c91-b4fd-0a6c371a0711 tempest-VolumesTransfersV355Test-269854922 None] Lock "cinder-5a1ba1ae-9434-4bde-a7fa-9f0083f227b7-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Flow 'volume_create_manager' (d1c2b4b2-7423-47c6-b107-e450e35cb469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5968c24-06a1-48f4-943d-b2dfcb90f3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5968c24-06a1-48f4-943d-b2dfcb90f3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405278673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13283f8550e4774a9bcb2b49ff1bb10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:48Z,use_quota=True,user_id='7662e2e099014783a38e3aab67596f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55cad380-8f8c-4efd-a3d5-ec4e729354f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55cad380-8f8c-4efd-a3d5-ec4e729354f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48aca80c-5e2b-402a-b8f1-1803514370be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48aca80c-5e2b-402a-b8f1-1803514370be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c', 'volume_name': 'volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14c4df3-917f-42df-84b8-47e080fe7c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14c4df3-917f-42df-84b8-47e080fe7c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8b614f-81b4-4d6d-b950-70a4f82d5ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:47 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Volume bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c', 'volume_size': 1} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405278673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13283f8550e4774a9bcb2b49ff1bb10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:48Z,use_quota=True,user_id='7662e2e099014783a38e3aab67596f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Creating volume bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:47 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:47 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c 1073741824 Feb 27 22:25:47 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:48 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c 1073741824" returned: 0 in 0.737s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:48 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c Feb 27 22:25:48 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:49 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c" returned: 0 in 0.575s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.184s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-55ac5fea-ee87-477f-9269-7df547f295f2-985283aa-3722-49b6-9377-209a74650254" by "_create_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-55ac5fea-ee87-477f-9269-7df547f295f2-985283aa-3722-49b6-9377-209a74650254" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Creating volume 985283aa-3722-49b6-9377-209a74650254 from snapshot 55ac5fea-ee87-477f-9269-7df547f295f2 {{(pid=83540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-985283aa-3722-49b6-9377-209a74650254" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8b614f-81b4-4d6d-b950-70a4f82d5ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38df428f-023d-48e0-a956-728975bf987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-985283aa-3722-49b6-9377-209a74650254" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] snapshot: 55ac5fea-ee87-477f-9269-7df547f295f2, volume: 985283aa-3722-49b6-9377-209a74650254, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:25:49 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Volume volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c (bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c): created successfully Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38df428f-023d-48e0-a956-728975bf987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Flow 'volume_create_manager' (d1c2b4b2-7423-47c6-b107-e450e35cb469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:49 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b9ec8ffd-17b7-4359-820f-aa1d1db981df tempest-VolumesTransfersV355Test-1475626731 None] Created volume successfully. Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[445c7620-8dad-4ed1-a1d0-d82fc84eb14f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:49 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 Feb 27 22:25:49 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:49 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2" returned: 0 in 0.566s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce369c2-e837-4826-92c3-40430258e2ea]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:50 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 Feb 27 22:25:50 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Acquiring lock "cinder-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Lock "cinder-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Acquiring lock "cinder-quobyte-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Lock "cinder-quobyte-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd924c-9cb4-4161-81b2-f0837959ee6c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:50 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c Feb 27 22:25:50 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:50 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" returned: 0 in 0.771s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:50 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 Feb 27 22:25:50 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:50 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c" returned: 0 in 0.600s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:50 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c Feb 27 22:25:50 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:51 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c" returned: 0 in 0.974s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Lock "cinder-quobyte-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c" released by "delete_volume" :: held 1.613s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:51 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Created reservations ['b75d8531-ba6d-4600-b300-26454bccdb84', '71bf0fed-7f29-4492-95e6-b98208b572d4', '69b2255e-c37c-4ece-a3b3-3fe5d9fe0b12', '309bed2c-5fb2-4a2c-8445-bf747bc3b680'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:52 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:52 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:53 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254" returned: 0 in 3.223s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:53 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a04a34c-b16c-4929-a08c-b2d8aa9deb19]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:53 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.830s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:53 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:53 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Deleted volume successfully. Feb 27 22:25:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f361784c-cb39-4fcf-828e-2e3da9428005 tempest-VolumesTransfersV355Test-269854922 None] Lock "cinder-bfd28d55-c4f1-4d69-ad63-3e3bf73b5b1c-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:54 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 Feb 27 22:25:54 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:54 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" returned: 0 in 0.972s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:54 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9, size 1024.00 MB, duration 3.22 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:25:54 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Converted 1024.00 MB image at 317.55 MB/s Feb 27 22:25:54 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:25:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:54 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 Feb 27 22:25:54 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:55 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254" returned: 0 in 0.576s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-985283aa-3722-49b6-9377-209a74650254" released by "_copy_volume_from_snapshot" :: held 6.239s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-55ac5fea-ee87-477f-9269-7df547f295f2-985283aa-3722-49b6-9377-209a74650254" released by "_create_volume_from_snapshot" :: held 6.288s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.301s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:55 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-06a62cc4-da0f-406c-82e3-afed7da5db19 tempest-GroupSnapshotsTest-1553791753 None] Create group from source-snapshot-3b44a956-8a0e-406b-860f-3918d7723fcf completed successfully. Feb 27 22:25:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-985283aa-3722-49b6-9377-209a74650254" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-985283aa-3722-49b6-9377-209a74650254" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:56 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ab873-f25f-412f-a3ac-cec6499ba2c2]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:56 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 Feb 27 22:25:56 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:56 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254" returned: 0 in 0.739s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:57 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254 Feb 27 22:25:57 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:57 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-985283aa-3722-49b6-9377-209a74650254" returned: 0 in 0.571s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-985283aa-3722-49b6-9377-209a74650254" released by "delete_volume" :: held 1.358s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['6fb69289-e973-4d7c-bef6-88fdf48f960f'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:57 devstack cinder-volume[83540]: WARNING cinder.quota [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1219487808 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1219487808, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:25:57 devstack cinder-volume[83540]: WARNING cinder.quota [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1219487808 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1219487808, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['4af955c5-07f0-41e7-a7a2-7f1351d6f594', 'ca01affd-979f-497f-a7aa-02e7dc93ee93', '723f1ebf-79d8-43f7-9c6e-e4182d5e4aaa', '02b691d6-a378-4202-b40f-7219747b7cfd'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:57 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:25:57 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:58 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.521s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:25:58 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8b31b62a-747f-4732-82c7-9bcc44e80705 tempest-GroupSnapshotsTest-1553791753 None] Delete group completed successfully. Feb 27 22:25:58 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] group_snapshot 3b44a956-8a0e-406b-860f-3918d7723fcf: deleting Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] group_snapshot 3b44a956-8a0e-406b-860f-3918d7723fcf: deleting {{(pid=83540) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4353}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-55ac5fea-ee87-477f-9269-7df547f295f2" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-55ac5fea-ee87-477f-9269-7df547f295f2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Deleting offline snapshot 55ac5fea-ee87-477f-9269-7df547f295f2 of volume 0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] snapshot_file for this snap is: volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ea0117-f419-4a35-827f-ac53a7e7e791]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:58 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 Feb 27 22:25:58 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:59 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2" returned: 0 in 0.621s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9919b1-3704-4e3f-82e5-4b7547563e13]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:59 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 Feb 27 22:25:59 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Flow 'volume_create_manager' (9c01c409-a9d6-425d-8a0e-ede184bf3319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb9935b-5c39-4098-941a-d101af92d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb9935b-5c39-4098-941a-d101af92d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2100057749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5472e7822b54852b1bb486c8778e51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:59Z,use_quota=True,user_id='18aa066e5fe84eb0b913c8c08815c9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c46a678-0e0f-4c45-a856-0cf5e2b91b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c46a678-0e0f-4c45-a856-0cf5e2b91b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78808a6-521b-4232-be3d-30248c175737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78808a6-521b-4232-be3d-30248c175737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f', 'volume_name': 'volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969b24ed-57b9-4648-a72d-3381925eabc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969b24ed-57b9-4648-a72d-3381925eabc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd16917-9ffb-4ea5-8794-273bac521480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:25:59 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Volume a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f', 'volume_size': 1} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2100057749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5472e7822b54852b1bb486c8778e51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:25:59Z,use_quota=True,user_id='18aa066e5fe84eb0b913c8c08815c9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Creating volume a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:25:59 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:59 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f 1073741824 Feb 27 22:25:59 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:25:59 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" returned: 0 in 0.650s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:25:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:25:59 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 Feb 27 22:25:59 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:00 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Flow 'volume_create_manager' (24375ef5-edbc-4ffc-a7bc-0de7c70397ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f28423-71c6-4ebc-b390-a089ed55b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f28423-71c6-4ebc-b390-a089ed55b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-533018525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57aa1c06-2b78-494c-a955-ecc99a12a33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c40e3386a64eb99dfc85ca4d5b3ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:00Z,use_quota=True,user_id='338aba6cff124bd8afe98cb927ffc8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9925ec-75f9-4f8c-80fc-04fba65f5906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9925ec-75f9-4f8c-80fc-04fba65f5906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d4ffee-3770-4489-82c0-7ca40a2fae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d4ffee-3770-4489-82c0-7ca40a2fae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57aa1c06-2b78-494c-a955-ecc99a12a33e', 'volume_name': 'volume-57aa1c06-2b78-494c-a955-ecc99a12a33e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ba77e1-c775-4a71-9f81-a1c3dac8caf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ba77e1-c775-4a71-9f81-a1c3dac8caf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7995e968-12ba-441d-b78f-bc2e26dce210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:00 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Volume 57aa1c06-2b78-494c-a955-ecc99a12a33e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57aa1c06-2b78-494c-a955-ecc99a12a33e', 'volume_size': 1} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f 1073741824" returned: 0 in 0.703s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:00 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2" returned: 0 in 0.543s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:00 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f Feb 27 22:26:00 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:00 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2 Feb 27 22:26:00 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:00 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9.55ac5fea-ee87-477f-9269-7df547f295f2" returned: 0 in 0.437s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-55ac5fea-ee87-477f-9269-7df547f295f2" released by "_delete_snapshot" :: held 2.315s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" released by "delete_snapshot" :: held 2.329s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:00 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f" returned: 0 in 0.493s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-533018525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57aa1c06-2b78-494c-a955-ecc99a12a33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c40e3386a64eb99dfc85ca4d5b3ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:00Z,use_quota=True,user_id='338aba6cff124bd8afe98cb927ffc8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Creating volume 57aa1c06-2b78-494c-a955-ecc99a12a33e {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:00 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:00 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e 1073741824 Feb 27 22:26:00 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd16917-9ffb-4ea5-8794-273bac521480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0479d4b5-ec36-47dc-9b96-da6115c5df6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:00 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Volume volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f (a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f): created successfully Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0479d4b5-ec36-47dc-9b96-da6115c5df6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Flow 'volume_create_manager' (9c01c409-a9d6-425d-8a0e-ede184bf3319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:00 devstack cinder-volume[83540]: WARNING cinder.quota [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1219487808 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1219487808, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:26:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8272bf1c-81e3-42c9-ae66-b9a18daabae2 tempest-VolumesTransfersTest-1986056771 None] Created volume successfully. Feb 27 22:26:00 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['a848d926-25d6-4edf-822b-9abd309afeb7', 'd51203b8-4122-4331-8a5c-5eae31e5be92', 'dba3dbcc-e160-476e-876b-d167f662ccc6', '9264ac87-1af0-4b4f-918b-2e1e05bb1ef4'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d8db139b-bae6-4ff1-992e-4fc725ab9364 tempest-GroupSnapshotsTest-1553791753 None] group_snapshot 3b44a956-8a0e-406b-860f-3918d7723fcf: deleted successfully Feb 27 22:26:01 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e 1073741824" returned: 0 in 0.590s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:01 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e Feb 27 22:26:01 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a8ce70-a740-4a82-b59a-b546283cc902]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:02 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e" returned: 0 in 0.609s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7995e968-12ba-441d-b78f-bc2e26dce210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57aa1c06-2b78-494c-a955-ecc99a12a33e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3a0bb2-bf2e-49fc-b6dc-aaf9472ee5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:02 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Volume volume-57aa1c06-2b78-494c-a955-ecc99a12a33e (57aa1c06-2b78-494c-a955-ecc99a12a33e): created successfully Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3a0bb2-bf2e-49fc-b6dc-aaf9472ee5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Flow 'volume_create_manager' (24375ef5-edbc-4ffc-a7bc-0de7c70397ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:02 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 Feb 27 22:26:02 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:02 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7004d413-65f7-4b2a-8abc-80277d0acd37 tempest-VolumesTransfersV357Test-1620726283 None] Created volume successfully. Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=152,cinder:INSERT=32,cinder:UPDATE=178,cinder:DELETE=12 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:26:02 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1a639606-e163-48b1-b64c-34ffd345dc72 tempest-VolumesTransfersTest-177533476 None] Transfer volume completed successfully. Feb 27 22:26:02 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" returned: 0 in 0.601s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:02 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9 Feb 27 22:26:02 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:02 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f535fc43-ef9d-499a-9a55-c241fc9d335a tempest-VolumesTransfersV357Test-1191235293 None] Transfer volume completed successfully. Feb 27 22:26:03 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" returned: 0 in 0.508s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-0e0c5f52-0989-44b4-951a-3df0f5af5bd9" released by "delete_volume" :: held 1.160s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['dab44311-df4e-4c64-8fb8-f812794a5a47'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:03 devstack cinder-volume[83540]: WARNING cinder.db.sqlalchemy.api [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1219487808'] Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['011cacd8-c2f5-4058-b7b4-4a312c98916f', '3e6133c4-8ca8-4687-817a-59749d6dadd5', '44a9d63b-2c7c-429b-bcbf-26de70e86eff', '2c3a4492-85a5-4d7e-a7f0-0e21a00274f1'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Acquiring lock "cinder-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:03 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:03 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Lock "cinder-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Acquiring lock "cinder-quobyte-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Lock "cinder-quobyte-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe9a70b-25a0-49d3-b29e-9c7e124385b2]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:03 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f Feb 27 22:26:03 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:03 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.562s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-bdee514f-19bf-4f29-89c7-e91ce36a1271 tempest-GroupSnapshotsTest-1553791753 None] Delete group completed successfully. Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Acquiring lock "cinder-57aa1c06-2b78-494c-a955-ecc99a12a33e-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Lock "cinder-57aa1c06-2b78-494c-a955-ecc99a12a33e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Acquiring lock "cinder-quobyte-57aa1c06-2b78-494c-a955-ecc99a12a33e" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Lock "cinder-quobyte-57aa1c06-2b78-494c-a955-ecc99a12a33e" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7469f33-f732-41b0-a702-3da1da2e4a2f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:04 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f" returned: 0 in 0.634s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:04 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e Feb 27 22:26:04 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:04 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f Feb 27 22:26:04 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0a7dffa3-8e81-44c2-896c-bc877dec8490 tempest-GroupSnapshotsTest-1553791753 None] Group tempest-GroupSnapshotsTest-Group-576558304: creating Feb 27 22:26:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0a7dffa3-8e81-44c2-896c-bc877dec8490 tempest-GroupSnapshotsTest-1553791753 None] Group tempest-GroupSnapshotsTest-Group-576558304: created successfully Feb 27 22:26:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0a7dffa3-8e81-44c2-896c-bc877dec8490 tempest-GroupSnapshotsTest-1553791753 None] Create group completed successfully. Feb 27 22:26:04 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e" returned: 0 in 0.643s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:04 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e Feb 27 22:26:04 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:04 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f" returned: 0 in 0.697s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Lock "cinder-quobyte-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f" released by "delete_volume" :: held 1.358s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Created reservations ['f4d34ed6-8c8b-4796-8353-6164224cad5f', 'fb1841c9-6b46-4916-a7d3-5509b3338b0d', '69b53298-1a8a-4624-9f35-8bde24cefa78', 'bb86fa18-3c03-4d52-8674-03e161e90d11'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:04 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:04 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:05 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-57aa1c06-2b78-494c-a955-ecc99a12a33e" returned: 0 in 0.607s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Lock "cinder-quobyte-57aa1c06-2b78-494c-a955-ecc99a12a33e" released by "delete_volume" :: held 1.285s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Created reservations ['45723876-13f1-427b-b036-517819b1f0a6', 'a84ed79d-6672-4f65-a7e5-d4fc5061dd6e', '634dfe6b-efa2-4355-b2dd-c6c174e2411b', '20922fdc-7e49-4cb0-a5da-8fc9d5e11b40'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:05 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.534s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:05 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:05 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:05 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Deleted volume successfully. Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-95b1f9e4-60b2-482e-a405-ec30f7032799 tempest-VolumesTransfersTest-101091994 None] Lock "cinder-a1d8d54d-fd68-4b75-9bc7-ae52d6ceae5f-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:05 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.579s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Flow 'volume_create_manager' (25e94db6-f52c-4e70-bc4c-b37a2b82d78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125114e9-e92c-44ab-bc87-94f368d687ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:05 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Deleted volume successfully. Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125114e9-e92c-44ab-bc87-94f368d687ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1104521903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f6bac3-7dc4-47b9-86a4-15ab169fb2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5472e7822b54852b1bb486c8778e51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:06Z,use_quota=True,user_id='18aa066e5fe84eb0b913c8c08815c9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63eb0919-dbf9-4659-b065-8263e6c03dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63eb0919-dbf9-4659-b065-8263e6c03dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42603604-0773-4044-9eae-305037df3540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42603604-0773-4044-9eae-305037df3540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f6bac3-7dc4-47b9-86a4-15ab169fb2eb', 'volume_name': 'volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc51d794-76c7-4305-b371-e8b06051ef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc51d794-76c7-4305-b371-e8b06051ef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8740cdba-a65f-4380-87dc-97c009718655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Volume 86f6bac3-7dc4-47b9-86a4-15ab169fb2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb', 'volume_size': 1} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1104521903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f6bac3-7dc4-47b9-86a4-15ab169fb2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5472e7822b54852b1bb486c8778e51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:06Z,use_quota=True,user_id='18aa066e5fe84eb0b913c8c08815c9ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Creating volume 86f6bac3-7dc4-47b9-86a4-15ab169fb2eb {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:06 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-ac73d974-51a0-416c-a4f0-84f3e7d24190 tempest-VolumesTransfersV357Test-145420087 None] Lock "cinder-57aa1c06-2b78-494c-a955-ecc99a12a33e-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:06 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb 1073741824 Feb 27 22:26:06 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Flow 'volume_create_manager' (7fa517cf-b33c-42d8-a198-d53f6164d34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681fcbb2-23b0-4573-bcd8-8ba75c723c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681fcbb2-23b0-4573-bcd8-8ba75c723c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1246105663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=569b020f-bcac-42bf-840f-c2ca05c5a872,host='devstack@QuobyteHD#QuobyteHD',id=150e000c-6961-4e18-a0ad-efc8335f6a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b7d911867f405386dcff0d413815e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:06Z,use_quota=True,user_id='225f0633c14d49c0884c90eb91e70560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bef7c608-7d64-409a-a701-c8b4f9b315e4),volume_type_id=bef7c608-7d64-409a-a701-c8b4f9b315e4)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df063d38-8fef-4bae-aaf4-f145256c1e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df063d38-8fef-4bae-aaf4-f145256c1e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95610518-9d38-434c-ab0c-ceee4b3596d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95610518-9d38-434c-ab0c-ceee4b3596d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150e000c-6961-4e18-a0ad-efc8335f6a78', 'volume_name': 'volume-150e000c-6961-4e18-a0ad-efc8335f6a78', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b71dae-0d40-4b9e-bbce-90ee18b5303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b71dae-0d40-4b9e-bbce-90ee18b5303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd4cc71-329a-47eb-bccd-ac256a161600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Volume 150e000c-6961-4e18-a0ad-efc8335f6a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150e000c-6961-4e18-a0ad-efc8335f6a78', 'volume_size': 1} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Flow 'volume_create_manager' (fedca37a-0e6b-4bd2-96ed-7a4dfdce54f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7132f699-89b0-435e-89fd-f5a8571f702b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7132f699-89b0-435e-89fd-f5a8571f702b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1406277157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14e774b-2af5-47b4-8892-297705b6b47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c40e3386a64eb99dfc85ca4d5b3ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:06Z,use_quota=True,user_id='338aba6cff124bd8afe98cb927ffc8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421ff695-6c76-49da-a5ba-df44f8436021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421ff695-6c76-49da-a5ba-df44f8436021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df4b430-99bb-4b1a-b460-63e6e93b33b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df4b430-99bb-4b1a-b460-63e6e93b33b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14e774b-2af5-47b4-8892-297705b6b47d', 'volume_name': 'volume-c14e774b-2af5-47b4-8892-297705b6b47d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32874ca-b0b9-4fdc-9c05-b288336c2efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32874ca-b0b9-4fdc-9c05-b288336c2efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f671e0c9-0b7d-4205-a7d3-c7603d9819e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Volume c14e774b-2af5-47b4-8892-297705b6b47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14e774b-2af5-47b4-8892-297705b6b47d', 'volume_size': 1} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:06 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb 1073741824" returned: 0 in 0.668s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:06 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb Feb 27 22:26:06 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Flow 'volume_create_manager' (6149b4cd-5a59-4661-be25-b6eac56d9be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ac9c2a-1ece-45ad-b444-b2f6122438a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ac9c2a-1ece-45ad-b444-b2f6122438a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-673485039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7de7d6-8a62-4521-b713-dda951dcb2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d2a03c4a04441cb681b8bbe760a5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:07Z,use_quota=True,user_id='0968f440deec4310981f4a525a715c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468b2732-0d97-481b-8849-fa6f656fbda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468b2732-0d97-481b-8849-fa6f656fbda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2af90a-0174-4934-a845-c9b656d66423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2af90a-0174-4934-a845-c9b656d66423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7de7d6-8a62-4521-b713-dda951dcb2c1', 'volume_name': 'volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb557cf0-13bc-4703-9fed-b6ae8eef6c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb557cf0-13bc-4703-9fed-b6ae8eef6c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48952c6-3c07-4bb4-b790-4a6167161291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:06 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Volume cd7de7d6-8a62-4521-b713-dda951dcb2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1', 'volume_size': 1} Feb 27 22:26:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:07 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb" returned: 0 in 0.423s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=569b020f-bcac-42bf-840f-c2ca05c5a872,created_at=2026-02-27T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1246105663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=569b020f-bcac-42bf-840f-c2ca05c5a872,host='devstack@QuobyteHD#QuobyteHD',id=150e000c-6961-4e18-a0ad-efc8335f6a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b7d911867f405386dcff0d413815e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:06Z,use_quota=True,user_id='225f0633c14d49c0884c90eb91e70560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bef7c608-7d64-409a-a701-c8b4f9b315e4),volume_type_id=bef7c608-7d64-409a-a701-c8b4f9b315e4)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Creating volume 150e000c-6961-4e18-a0ad-efc8335f6a78 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:07 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8740cdba-a65f-4380-87dc-97c009718655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:07 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 1073741824 Feb 27 22:26:07 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36faefb4-dc4c-483b-ac03-7a2026665f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:07 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Volume volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb (86f6bac3-7dc4-47b9-86a4-15ab169fb2eb): created successfully Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36faefb4-dc4c-483b-ac03-7a2026665f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Flow 'volume_create_manager' (25e94db6-f52c-4e70-bc4c-b37a2b82d78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:07 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2f717212-7c73-4d34-bf14-42de30306f25 tempest-VolumesTransfersTest-1986056771 None] Created volume successfully. Feb 27 22:26:07 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 1073741824" returned: 0 in 0.479s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:07 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 Feb 27 22:26:07 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:08 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78" returned: 0 in 0.447s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1406277157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14e774b-2af5-47b4-8892-297705b6b47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c40e3386a64eb99dfc85ca4d5b3ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:06Z,use_quota=True,user_id='338aba6cff124bd8afe98cb927ffc8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Creating volume c14e774b-2af5-47b4-8892-297705b6b47d {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:08 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:08 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d 1073741824 Feb 27 22:26:08 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd4cc71-329a-47eb-bccd-ac256a161600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150e000c-6961-4e18-a0ad-efc8335f6a78', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02736c58-e4ad-42bd-b8dc-3eba5c6a567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:08 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Volume volume-150e000c-6961-4e18-a0ad-efc8335f6a78 (150e000c-6961-4e18-a0ad-efc8335f6a78): created successfully Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02736c58-e4ad-42bd-b8dc-3eba5c6a567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Flow 'volume_create_manager' (7fa517cf-b33c-42d8-a198-d53f6164d34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:08 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7cc3aa72-7696-4820-b225-dcacd9d7bf0c tempest-GroupSnapshotsTest-1553791753 None] Created volume successfully. Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Acquiring lock "cinder-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Lock "cinder-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Acquiring lock "cinder-quobyte-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Lock "cinder-quobyte-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c4e446-3054-443c-85c7-94ec00879c58]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:08 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb Feb 27 22:26:08 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:08 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d 1073741824" returned: 0 in 0.494s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:08 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d Feb 27 22:26:08 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:08 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb" returned: 0 in 0.549s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:08 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb Feb 27 22:26:08 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:09 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d" returned: 0 in 0.410s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-673485039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7de7d6-8a62-4521-b713-dda951dcb2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d2a03c4a04441cb681b8bbe760a5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:07Z,use_quota=True,user_id='0968f440deec4310981f4a525a715c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Creating volume cd7de7d6-8a62-4521-b713-dda951dcb2c1 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:09 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f671e0c9-0b7d-4205-a7d3-c7603d9819e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14e774b-2af5-47b4-8892-297705b6b47d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2152e140-9002-4b5d-9aab-046a912f1ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:09 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 1073741824 Feb 27 22:26:09 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:09 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Volume volume-c14e774b-2af5-47b4-8892-297705b6b47d (c14e774b-2af5-47b4-8892-297705b6b47d): created successfully Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2152e140-9002-4b5d-9aab-046a912f1ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Flow 'volume_create_manager' (fedca37a-0e6b-4bd2-96ed-7a4dfdce54f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:09 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f9d96381-dbed-4e02-a282-840f87484cdc tempest-VolumesTransfersV357Test-1620726283 None] Created volume successfully. Feb 27 22:26:09 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb" returned: 0 in 0.473s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Lock "cinder-quobyte-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb" released by "delete_volume" :: held 1.048s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Created reservations ['ee0d9f1b-50ee-417f-8309-182b0debb0c3', '332850a9-2e7d-4e1a-b7a0-1a2e7b962963', '6a4b7edc-2ebb-4140-ba90-1a596d208889', '7a794b40-70ec-470b-bbdd-25865fc23ac8'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:09 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:09 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Flow 'volume_create_manager' (ac681026-c413-4d18-b3eb-41b2b6951d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3db7c7-9bb2-42ab-8548-ee1ff94e921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3db7c7-9bb2-42ab-8548-ee1ff94e921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1041516315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=569b020f-bcac-42bf-840f-c2ca05c5a872,host='devstack@QuobyteHD#QuobyteHD',id=a991a47e-22f7-4a68-917a-d54e460f3b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b7d911867f405386dcff0d413815e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:10Z,use_quota=True,user_id='225f0633c14d49c0884c90eb91e70560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bef7c608-7d64-409a-a701-c8b4f9b315e4),volume_type_id=bef7c608-7d64-409a-a701-c8b4f9b315e4)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed944e7-0141-4d94-894d-ca35ae2c6127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed944e7-0141-4d94-894d-ca35ae2c6127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e3f42c-2ad0-4acc-9476-c3c3971686f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e3f42c-2ad0-4acc-9476-c3c3971686f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a991a47e-22f7-4a68-917a-d54e460f3b36', 'volume_name': 'volume-a991a47e-22f7-4a68-917a-d54e460f3b36', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f170e08f-94e2-4537-be3e-cc81a7651929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f170e08f-94e2-4537-be3e-cc81a7651929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd05af9c-8446-4736-a320-1cea9d08450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:09 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Volume a991a47e-22f7-4a68-917a-d54e460f3b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a991a47e-22f7-4a68-917a-d54e460f3b36', 'volume_size': 1} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:09 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 1073741824" returned: 0 in 0.610s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:09 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 Feb 27 22:26:09 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Acquiring lock "cinder-c14e774b-2af5-47b4-8892-297705b6b47d-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Lock "cinder-c14e774b-2af5-47b4-8892-297705b6b47d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Acquiring lock "cinder-quobyte-c14e774b-2af5-47b4-8892-297705b6b47d" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Lock "cinder-quobyte-c14e774b-2af5-47b4-8892-297705b6b47d" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b3af01-a5fa-4f34-8144-b5569c96d81e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:10 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.584s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:10 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Deleted volume successfully. Feb 27 22:26:10 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d Feb 27 22:26:10 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-53d17efd-cb7f-4bd7-801c-89602323977a tempest-VolumesTransfersTest-101091994 None] Lock "cinder-86f6bac3-7dc4-47b9-86a4-15ab169fb2eb-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:10 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1" returned: 0 in 0.468s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=569b020f-bcac-42bf-840f-c2ca05c5a872,created_at=2026-02-27T21:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1041516315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=569b020f-bcac-42bf-840f-c2ca05c5a872,host='devstack@QuobyteHD#QuobyteHD',id=a991a47e-22f7-4a68-917a-d54e460f3b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b7d911867f405386dcff0d413815e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:10Z,use_quota=True,user_id='225f0633c14d49c0884c90eb91e70560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bef7c608-7d64-409a-a701-c8b4f9b315e4),volume_type_id=bef7c608-7d64-409a-a701-c8b4f9b315e4)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Creating volume a991a47e-22f7-4a68-917a-d54e460f3b36 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:10 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48952c6-3c07-4bb4-b790-4a6167161291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1d9749-01cb-41c1-88f2-f5d496bc2cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:10 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 1073741824 Feb 27 22:26:10 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:10 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Volume volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 (cd7de7d6-8a62-4521-b713-dda951dcb2c1): created successfully Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1d9749-01cb-41c1-88f2-f5d496bc2cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Flow 'volume_create_manager' (6149b4cd-5a59-4661-be25-b6eac56d9be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:10 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3c94e7d8-083c-408d-9783-4beaa2ead59e tempest-VolumesServicesTestJSON-1356455236 None] Created volume successfully. Feb 27 22:26:10 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d" returned: 0 in 0.543s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:10 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d Feb 27 22:26:10 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:10 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 1073741824" returned: 0 in 0.583s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:10 devstack sudo[87536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 Feb 27 22:26:10 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:11 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c14e774b-2af5-47b4-8892-297705b6b47d" returned: 0 in 0.493s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Lock "cinder-quobyte-c14e774b-2af5-47b4-8892-297705b6b47d" released by "delete_volume" :: held 1.089s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Created reservations ['2b43c55d-da2c-4cc9-baba-82befffaa40a', '7aff2509-ae2c-45ce-9b28-b3bc5b8f1354', '61c6c876-ab21-46a0-9990-3bb915276717', '73e36dea-12f9-4b68-9cc2-4334ea5aefd4'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:11 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:11 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Acquiring lock "cinder-cd7de7d6-8a62-4521-b713-dda951dcb2c1-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Lock "cinder-cd7de7d6-8a62-4521-b713-dda951dcb2c1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Acquiring lock "cinder-quobyte-cd7de7d6-8a62-4521-b713-dda951dcb2c1" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Lock "cinder-quobyte-cd7de7d6-8a62-4521-b713-dda951dcb2c1" acquired by "delete_volume" :: waited 0.025s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[071727b3-cba1-4a10-8f4d-b3dc9bd34214]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:11 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36" returned: 0 in 0.541s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:11 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 Feb 27 22:26:11 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd05af9c-8446-4736-a320-1cea9d08450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a991a47e-22f7-4a68-917a-d54e460f3b36', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b3beb8-d03c-4eb8-be62-2a40acad3dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:11 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Volume volume-a991a47e-22f7-4a68-917a-d54e460f3b36 (a991a47e-22f7-4a68-917a-d54e460f3b36): created successfully Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b3beb8-d03c-4eb8-be62-2a40acad3dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Flow 'volume_create_manager' (ac681026-c413-4d18-b3eb-41b2b6951d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-90e8c254-567e-4cb4-9c0e-6639e18b030c tempest-GroupSnapshotsTest-1553791753 None] Created volume successfully. Feb 27 22:26:11 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.650s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Deleted volume successfully. Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-453e82c4-55a5-454b-b850-b7a01fa73855 tempest-VolumesTransfersV357Test-145420087 None] Lock "cinder-c14e774b-2af5-47b4-8892-297705b6b47d-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:11 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1" returned: 0 in 0.612s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:11 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1 Feb 27 22:26:11 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d44d77b4-4560-4a2c-9b55-9df4811dfa70 tempest-GroupSnapshotsTest-1553791753 None] Update group completed successfully. Feb 27 22:26:12 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cd7de7d6-8a62-4521-b713-dda951dcb2c1" returned: 0 in 0.546s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Lock "cinder-quobyte-cd7de7d6-8a62-4521-b713-dda951dcb2c1" released by "delete_volume" :: held 1.191s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Created reservations ['24aeabd7-96be-422b-8cca-46b45e220773', '50b88f89-42ec-4522-96ba-fa64ffe35163', '838ee4fc-482f-4727-a1ab-b98f75d7e3b6', '8a18fbf7-2d4e-4869-81c8-270f9aff80f3'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:12 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:12 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:13 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.566s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:13 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:13 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Deleted volume successfully. Feb 27 22:26:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e1e18091-0099-457f-81ea-0b5c79f8e5f7 tempest-VolumesServicesTestJSON-1356455236 None] Lock "cinder-cd7de7d6-8a62-4521-b713-dda951dcb2c1-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:13 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-acdddd5f-e64d-451d-a5a6-d25a83204b76 tempest-GroupSnapshotsTest-1553791753 None] Update group completed successfully. Feb 27 22:26:14 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-cfbeb1b5-de83-4c44-872d-c6d255365b0e tempest-GroupSnapshotsTest-1553791753 None] Update group completed successfully. Feb 27 22:26:15 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d961b9fb-f676-4124-a4d4-2791ca9ba278 tempest-GroupSnapshotsTest-1553791753 None] Update group completed successfully. Feb 27 22:26:16 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] GroupSnapshot a9d6d290-a644-4491-a90e-865e484121dc: creating. Feb 27 22:26:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Group snapshot a9d6d290-a644-4491-a90e-865e484121dc: creating. {{(pid=83540) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4178}} Feb 27 22:26:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Creating offline snapshot 12f46af8-c220-445b-a210-67b5b468a2db of volume a991a47e-22f7-4a68-917a-d54e460f3b36 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:26:16 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7948a8-3e0f-4d98-b809-e95638c493ee]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:17 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 Feb 27 22:26:17 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Flow 'volume_create_manager' (bc3ca470-74cf-4ff9-a3f8-22889265a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63178d22-38f9-419c-aab3-353ce79e06e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63178d22-38f9-419c-aab3-353ce79e06e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1158297065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9d0954-f483-4f7b-b9e5-fb51ed33ba30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77ce7e0a34c48509564fe0c277433c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:17Z,use_quota=True,user_id='73bf9478854e4d9bbb1221d6b8f93faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cc33cc-da0c-4798-9f2d-7b3a83d55f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cc33cc-da0c-4798-9f2d-7b3a83d55f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65e8e5c-6320-41ef-80c6-ac9333825a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65e8e5c-6320-41ef-80c6-ac9333825a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9d0954-f483-4f7b-b9e5-fb51ed33ba30', 'volume_name': 'volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cace4a7-0aa2-44b1-8141-c63c07a97abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cace4a7-0aa2-44b1-8141-c63c07a97abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd2b582-aa9a-4cb1-9848-c52bce0460d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Volume dd9d0954-f483-4f7b-b9e5-fb51ed33ba30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30', 'volume_size': 1} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36" returned: 0 in 0.656s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:17 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db 1G Feb 27 22:26:17 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Flow 'volume_create_manager' (60d8bc99-20ed-461e-8976-f2afcb5789cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28cd9f2-7245-48a9-8f5a-380de93d942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28cd9f2-7245-48a9-8f5a-380de93d942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-747225721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129478c0-d9cc-4a86-a976-fc0d08ee9bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be80e4a977694822aa7c9b8fa39c43dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:17Z,use_quota=True,user_id='b3697f531b394c9289a383003ce70d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59c1237-39ff-4eb8-baa6-69a60875f857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59c1237-39ff-4eb8-baa6-69a60875f857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb07e9fe-1648-489b-82b1-5c273fbd9417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb07e9fe-1648-489b-82b1-5c273fbd9417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129478c0-d9cc-4a86-a976-fc0d08ee9bfc', 'volume_name': 'volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96a6067-52a5-4045-869d-2cf075ca9a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96a6067-52a5-4045-869d-2cf075ca9a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94835b1-a572-4593-8d57-c7d30628e723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Volume 129478c0-d9cc-4a86-a976-fc0d08ee9bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc', 'volume_size': 1} Feb 27 22:26:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:18 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db 1G" returned: 0 in 0.552s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a991a47e-22f7-4a68-917a-d54e460f3b36 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:18 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a991a47e-22f7-4a68-917a-d54e460f3b36 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db Feb 27 22:26:18 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:18 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a991a47e-22f7-4a68-917a-d54e460f3b36 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db" returned: 0 in 0.460s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:18 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:26:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:18 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db Feb 27 22:26:18 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:19 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db" returned: 0 in 0.515s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:19 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.info Feb 27 22:26:19 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:19 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.info" returned: 0 in 0.478s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:19 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:26:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:19 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.info Feb 27 22:26:19 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:20 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.info" returned: 0 in 0.434s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.154s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Creating offline snapshot e794f493-c2ff-43b4-b145-1155ce6c5f39 of volume 150e000c-6961-4e18-a0ad-efc8335f6a78 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ef7dbb-2962-466b-80ea-f39d2773fb66]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:20 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 Feb 27 22:26:20 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:20 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78" returned: 0 in 0.564s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:20 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 1G Feb 27 22:26:20 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:21 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 1G" returned: 0 in 0.535s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150e000c-6961-4e18-a0ad-efc8335f6a78 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:21 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150e000c-6961-4e18-a0ad-efc8335f6a78 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 Feb 27 22:26:21 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:21 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150e000c-6961-4e18-a0ad-efc8335f6a78 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39" returned: 0 in 0.562s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:21 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:26:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:21 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 Feb 27 22:26:21 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:22 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39" returned: 0 in 0.495s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:22 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.info Feb 27 22:26:22 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:22 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.info" returned: 0 in 0.512s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:22 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:26:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:22 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.info Feb 27 22:26:22 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:23 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.info" returned: 0 in 0.500s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.606s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-747225721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129478c0-d9cc-4a86-a976-fc0d08ee9bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be80e4a977694822aa7c9b8fa39c43dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:17Z,use_quota=True,user_id='b3697f531b394c9289a383003ce70d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Creating volume 129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:23 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:23 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc 1073741824 Feb 27 22:26:23 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:23 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-145fce0a-bc2d-49ab-a460-a5592e235a5c tempest-GroupSnapshotsTest-1553791753 None] group_snapshot a9d6d290-a644-4491-a90e-865e484121dc: created successfully Feb 27 22:26:23 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc 1073741824" returned: 0 in 0.647s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:24 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc Feb 27 22:26:24 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:24 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] group_snapshot a9d6d290-a644-4491-a90e-865e484121dc: deleting Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] group_snapshot a9d6d290-a644-4491-a90e-865e484121dc: deleting {{(pid=83540) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4353}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-a991a47e-22f7-4a68-917a-d54e460f3b36" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-a991a47e-22f7-4a68-917a-d54e460f3b36" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-12f46af8-c220-445b-a210-67b5b468a2db" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-12f46af8-c220-445b-a210-67b5b468a2db" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Deleting offline snapshot 12f46af8-c220-445b-a210-67b5b468a2db of volume a991a47e-22f7-4a68-917a-d54e460f3b36 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] snapshot_file for this snap is: volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae1e537-268f-4c06-bf67-8c56b9950621]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:24 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db Feb 27 22:26:24 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:24 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" returned: 0 in 0.583s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1158297065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9d0954-f483-4f7b-b9e5-fb51ed33ba30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77ce7e0a34c48509564fe0c277433c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:17Z,use_quota=True,user_id='73bf9478854e4d9bbb1221d6b8f93faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Creating volume dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:24 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94835b1-a572-4593-8d57-c7d30628e723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:24 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 1073741824 Feb 27 22:26:24 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649859dc-7949-43fe-8f6c-2a90dcfe2665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:24 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Volume volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc (129478c0-d9cc-4a86-a976-fc0d08ee9bfc): created successfully Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649859dc-7949-43fe-8f6c-2a90dcfe2665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Flow 'volume_create_manager' (60d8bc99-20ed-461e-8976-f2afcb5789cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:24 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-cfb73cdf-4545-4134-a8af-9a693c45d54e tempest-VolumesDeleteCascade-983129995 None] Created volume successfully. Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:25 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Flow 'volume_create_manager' (f5890666-9a18-4286-a582-37f1d852d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0623a9ce-3d3e-4d36-b995-5b695e78a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db" returned: 0 in 0.680s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a991a47e-22f7-4a68-917a-d54e460f3b36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0623a9ce-3d3e-4d36-b995-5b695e78a567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1193372259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c01ae5-0cd7-4639-8344-52587fcb16e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc0b959f0cb44b68675a613da5cc622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:25Z,use_quota=True,user_id='d1c7421f401c44afad50b8bdb45bdfa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404a85b0-0cc9-40ff-8a18-05382988532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404a85b0-0cc9-40ff-8a18-05382988532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdbf79b-4e1f-43e8-b671-36d6ec707df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdbf79b-4e1f-43e8-b671-36d6ec707df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c01ae5-0cd7-4639-8344-52587fcb16e2', 'volume_name': 'volume-78c01ae5-0cd7-4639-8344-52587fcb16e2', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f508a1a4-e63c-4861-ac47-ff9764130d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f508a1a4-e63c-4861-ac47-ff9764130d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fe5550-4895-44bb-b691-064ecbae062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:25 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Volume 78c01ae5-0cd7-4639-8344-52587fcb16e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c01ae5-0cd7-4639-8344-52587fcb16e2', 'volume_size': 1} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee0627e-1303-4a4d-8dff-da256ae99040]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:25 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 1073741824" returned: 0 in 0.606s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:25 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 Feb 27 22:26:25 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:25 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 Feb 27 22:26:25 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:25 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30" returned: 0 in 0.456s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1193372259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c01ae5-0cd7-4639-8344-52587fcb16e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc0b959f0cb44b68675a613da5cc622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:25Z,use_quota=True,user_id='d1c7421f401c44afad50b8bdb45bdfa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Creating volume 78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:25 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:25 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:25 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 1073741824 Feb 27 22:26:25 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd2b582-aa9a-4cb1-9848-c52bce0460d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbebcf7a-5302-4381-a5a7-3075d75d1c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:25 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db Feb 27 22:26:25 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:25 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Volume volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 (dd9d0954-f483-4f7b-b9e5-fb51ed33ba30): created successfully Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbebcf7a-5302-4381-a5a7-3075d75d1c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Flow 'volume_create_manager' (bc3ca470-74cf-4ff9-a3f8-22889265a79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:25 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f352524e-9978-45b7-9180-047fab7fc44c tempest-VolumesListTestJSON-944436800 None] Created volume successfully. Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Flow 'volume_create_manager' (e3740d51-b018-4b57-9184-e89eb54c38d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cc27c0-c2f2-4a8f-bc6c-cf3c0c85dbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cc27c0-c2f2-4a8f-bc6c-cf3c0c85dbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-603162783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06415e-5c5b-4bdf-802e-6e08be2b0c51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77ce7e0a34c48509564fe0c277433c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:26Z,use_quota=True,user_id='73bf9478854e4d9bbb1221d6b8f93faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961c0f31-0963-46ce-a5ff-f905f9f615a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961c0f31-0963-46ce-a5ff-f905f9f615a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd5a510-337d-4e2f-961f-88555073bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd5a510-337d-4e2f-961f-88555073bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a06415e-5c5b-4bdf-802e-6e08be2b0c51', 'volume_name': 'volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b636a0cb-9d84-4779-b204-6cf8406316f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b636a0cb-9d84-4779-b204-6cf8406316f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fea736d-04f8-428f-99ac-a9809c05f85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:26 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Volume 1a06415e-5c5b-4bdf-802e-6e08be2b0c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51', 'volume_size': 1} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:26 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 1073741824" returned: 0 in 0.573s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:26 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db" returned: 0 in 0.565s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:26 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db Feb 27 22:26:26 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:26 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:26:26 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:26 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36.12f46af8-c220-445b-a210-67b5b468a2db" returned: 0 in 0.430s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-12f46af8-c220-445b-a210-67b5b468a2db" released by "_delete_snapshot" :: held 2.304s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-a991a47e-22f7-4a68-917a-d54e460f3b36" released by "delete_snapshot" :: held 2.341s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-150e000c-6961-4e18-a0ad-efc8335f6a78" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-150e000c-6961-4e18-a0ad-efc8335f6a78" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-e794f493-c2ff-43b4-b145-1155ce6c5f39" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-e794f493-c2ff-43b4-b145-1155ce6c5f39" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Deleting offline snapshot e794f493-c2ff-43b4-b145-1155ce6c5f39 of volume 150e000c-6961-4e18-a0ad-efc8335f6a78 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:26:26 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] snapshot_file for this snap is: volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.468s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.572s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb661bf-02cb-4730-ab0c-9c8de84ae14d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fe5550-4895-44bb-b691-064ecbae062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c01ae5-0cd7-4639-8344-52587fcb16e2', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85658073-63cc-4ccf-9e24-e2c8d7a8951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Creating offline snapshot f86cc933-5472-4dbf-8bac-03ee2369e90a of volume 129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:26:26 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Volume volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 (78c01ae5-0cd7-4639-8344-52587fcb16e2): created successfully Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85658073-63cc-4ccf-9e24-e2c8d7a8951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Flow 'volume_create_manager' (f5890666-9a18-4286-a582-37f1d852d623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[616833a2-c787-4e25-919d-59228343b191]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:26 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d2150439-e693-4e5d-aba6-58667fc7dc52 tempest-VolumesActionsTest-408327979 None] Created volume successfully. Feb 27 22:26:26 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 Feb 27 22:26:26 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:26 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc Feb 27 22:26:26 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:27 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39" returned: 0 in 0.574s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-150e000c-6961-4e18-a0ad-efc8335f6a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:27 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48e5727-957c-426c-8453-a78c5b6f7109]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:27 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" returned: 0 in 0.566s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:27 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a 1G Feb 27 22:26:27 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:27 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 Feb 27 22:26:27 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:27 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a 1G" returned: 0 in 0.589s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:27 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78" returned: 0 in 0.645s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:28 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a Feb 27 22:26:28 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:28 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 Feb 27 22:26:28 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:28 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:28 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39" returned: 0 in 0.504s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a" returned: 0 in 0.526s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:28 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a is being set with open permissions: ugo+rw Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:28 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39 Feb 27 22:26:28 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:28 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a Feb 27 22:26:28 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:28 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78.e794f493-c2ff-43b4-b145-1155ce6c5f39" returned: 0 in 0.420s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-e794f493-c2ff-43b4-b145-1155ce6c5f39" released by "_delete_snapshot" :: held 2.202s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-150e000c-6961-4e18-a0ad-efc8335f6a78" released by "delete_snapshot" :: held 2.213s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:28 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:29 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.info Feb 27 22:26:29 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:29 devstack cinder-volume[83540]: WARNING cinder.quota [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-40122678 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-40122678, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:26:29 devstack cinder-volume[83540]: WARNING cinder.quota [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-40122678 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-40122678, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['daae23e1-5069-4b6b-9c1f-f15a7ff547b9', 'a6ae7a75-dde7-42e9-a585-941806372860', '7602cd6f-4dd0-45e7-9b98-f3633e3469b1', '833f1918-3c2b-4216-9898-22770c248a51'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['51436111-3092-4c41-96f8-62c18d848761', 'ccb83e16-9f25-412a-80b1-ceb1983168f4', '2587e098-a460-4f00-be5d-d02823793468', '6d1b4679-092c-4305-a06b-4e851acfb045'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c9fa06ff-e83b-4913-819c-b65c3f38eb9f tempest-GroupSnapshotsTest-1553791753 None] group_snapshot a9d6d290-a644-4491-a90e-865e484121dc: deleted successfully Feb 27 22:26:29 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.info" returned: 0 in 0.490s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:29 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.info is being set with open permissions: ugo+rw Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:29 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.info Feb 27 22:26:29 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-150e000c-6961-4e18-a0ad-efc8335f6a78" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-150e000c-6961-4e18-a0ad-efc8335f6a78" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5028d250-ffa5-4961-9256-7f5fea76c1d8]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:29 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.info" returned: 0 in 0.483s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.223s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.752s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-603162783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06415e-5c5b-4bdf-802e-6e08be2b0c51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77ce7e0a34c48509564fe0c277433c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:26Z,use_quota=True,user_id='73bf9478854e4d9bbb1221d6b8f93faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Creating volume 1a06415e-5c5b-4bdf-802e-6e08be2b0c51 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:30 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:30 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 Feb 27 22:26:30 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:30 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 1073741824 Feb 27 22:26:30 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:30 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d76c6ebd-cc74-43ac-b9d9-34fad69a8edb tempest-VolumesDeleteCascade-983129995 None] Create snapshot completed successfully Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:30 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78" returned: 0 in 0.593s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:30 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78 Feb 27 22:26:30 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:30 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 1073741824" returned: 0 in 0.554s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:30 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 Feb 27 22:26:30 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:31 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-150e000c-6961-4e18-a0ad-efc8335f6a78" returned: 0 in 0.465s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-150e000c-6961-4e18-a0ad-efc8335f6a78" released by "delete_volume" :: held 1.098s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-a991a47e-22f7-4a68-917a-d54e460f3b36" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-a991a47e-22f7-4a68-917a-d54e460f3b36" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8a9cae-4321-4740-b3c3-f7900a5c3ebf]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:31 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51" returned: 0 in 0.482s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.627s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fea736d-04f8-428f-99ac-a9809c05f85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1eb569-1b09-481a-a44c-3785421c5f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Creating offline snapshot f7cab9eb-9312-412a-8ba8-7101a4815764 of volume 129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:26:31 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Volume volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 (1a06415e-5c5b-4bdf-802e-6e08be2b0c51): created successfully Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1eb569-1b09-481a-a44c-3785421c5f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:31 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 Feb 27 22:26:31 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Flow 'volume_create_manager' (e3740d51-b018-4b57-9184-e89eb54c38d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d4de48-2d2e-46be-8970-986505fca675]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:31 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1fb98cab-a151-4412-b5ef-9a7e2b31b4f0 tempest-VolumesListTestJSON-944436800 None] Created volume successfully. Feb 27 22:26:31 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a Feb 27 22:26:31 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:31 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36" returned: 0 in 0.569s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:31 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36 Feb 27 22:26:31 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:31 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a" returned: 0 in 0.640s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:31 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 1G Feb 27 22:26:31 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Flow 'volume_create_manager' (a0d52d8f-9cbc-4911-9324-e2553cf4f31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e701e68b-a1a3-4644-b5d0-88ebccd7463c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e701e68b-a1a3-4644-b5d0-88ebccd7463c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-825987741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f6e110-48b4-4259-a7af-625b4333277f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77ce7e0a34c48509564fe0c277433c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:32Z,use_quota=True,user_id='73bf9478854e4d9bbb1221d6b8f93faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a9e4f5-1df9-4570-8c6a-8e4158691573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a9e4f5-1df9-4570-8c6a-8e4158691573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb80588f-7d94-4da6-84d3-4e0f0403493d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb80588f-7d94-4da6-84d3-4e0f0403493d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f6e110-48b4-4259-a7af-625b4333277f', 'volume_name': 'volume-70f6e110-48b4-4259-a7af-625b4333277f', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ad1c72-e559-4de9-8585-c45b5451e509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ad1c72-e559-4de9-8585-c45b5451e509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400fc45e-7547-4008-a332-d81924e0c5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:31 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Volume 70f6e110-48b4-4259-a7af-625b4333277f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f6e110-48b4-4259-a7af-625b4333277f', 'volume_size': 1} Feb 27 22:26:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:32 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a991a47e-22f7-4a68-917a-d54e460f3b36" returned: 0 in 0.601s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-a991a47e-22f7-4a68-917a-d54e460f3b36" released by "delete_volume" :: held 1.200s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=189,cinder:INSERT=45,cinder:UPDATE=191,cinder:DELETE=13 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['e3cc334b-d7ff-4ac3-8263-d27a4582277f'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:32 devstack cinder-volume[83540]: WARNING cinder.quota [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-40122678 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-40122678, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['bde97caf-a5e9-405d-83b2-8622745889fc', 'da7c05b4-917a-4d9b-a009-9c7316387712', 'f4393e77-0152-4d76-a370-2d59555938c9', '46d184e5-16d7-48f1-810a-6ae1fd40d4b1'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['7ce3c4b1-0c64-46c6-a979-2fdeac4b80ff', '6b7b8886-aa9e-4376-948e-c1293f692edd', '0a817b98-d8a7-4885-9b4e-ef9c11521a6a', '0daff020-9e82-41fc-854c-cda2e1a2e428'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:32 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 1G" returned: 0 in 0.621s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:32 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 Feb 27 22:26:32 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:32 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:32 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:33 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764" returned: 0 in 0.614s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:33 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 is being set with open permissions: ugo+rw Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:33 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 Feb 27 22:26:33 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:33 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.601s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9688e0a5-f2d8-4f38-9ecd-70726b1e2b28 tempest-GroupSnapshotsTest-1553791753 None] Delete group completed successfully. Feb 27 22:26:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8c488d69-a008-4a97-b75a-cfe25a4a838d tempest-GroupSnapshotsTest-1553791753 None] Group tempest-GroupSnapshotsTest-Group-1139733614: creating Feb 27 22:26:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8c488d69-a008-4a97-b75a-cfe25a4a838d tempest-GroupSnapshotsTest-1553791753 None] Group tempest-GroupSnapshotsTest-Group-1139733614: created successfully Feb 27 22:26:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8c488d69-a008-4a97-b75a-cfe25a4a838d tempest-GroupSnapshotsTest-1553791753 None] Create group completed successfully. Feb 27 22:26:33 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764" returned: 0 in 0.666s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.646s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-825987741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f6e110-48b4-4259-a7af-625b4333277f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77ce7e0a34c48509564fe0c277433c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:32Z,use_quota=True,user_id='73bf9478854e4d9bbb1221d6b8f93faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Creating volume 70f6e110-48b4-4259-a7af-625b4333277f {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:33 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:33 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f 1073741824 Feb 27 22:26:33 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-46dfe9b5-3631-495b-9153-cca2dffcbbb3 tempest-VolumesDeleteCascade-983129995 None] Create snapshot completed successfully Feb 27 22:26:34 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f 1073741824" returned: 0 in 0.579s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:34 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f Feb 27 22:26:34 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-129478c0-d9cc-4a86-a976-fc0d08ee9bfc-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-129478c0-d9cc-4a86-a976-fc0d08ee9bfc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Performing cascade delete. {{(pid=83540) delete_volume /opt/stack/cinder/cinder/volume/manager.py:998}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-f7cab9eb-9312-412a-8ba8-7101a4815764-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-f7cab9eb-9312-412a-8ba8-7101a4815764-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-f7cab9eb-9312-412a-8ba8-7101a4815764" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-f7cab9eb-9312-412a-8ba8-7101a4815764" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Deleting offline snapshot f7cab9eb-9312-412a-8ba8-7101a4815764 of volume 129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] snapshot_file for this snap is: volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec53c03-56da-42b6-a811-deccfe4789eb]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:34 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f" returned: 0 in 0.602s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400fc45e-7547-4008-a332-d81924e0c5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f6e110-48b4-4259-a7af-625b4333277f', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:34 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13aebaec-698d-403f-9d86-e60933b4141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:34 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Volume volume-70f6e110-48b4-4259-a7af-625b4333277f (70f6e110-48b4-4259-a7af-625b4333277f): created successfully Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13aebaec-698d-403f-9d86-e60933b4141a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Flow 'volume_create_manager' (a0d52d8f-9cbc-4911-9324-e2553cf4f31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:35 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8b9e874a-94bb-4ddf-88e4-1b9800c39f54 tempest-VolumesListTestJSON-944436800 None] Created volume successfully. Feb 27 22:26:35 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 Feb 27 22:26:35 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Flow 'volume_create_manager' (aeaa4b3b-98aa-4d17-8957-d38b0669cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94193df-07ae-45af-878d-7aff6b09ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94193df-07ae-45af-878d-7aff6b09ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936561397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d002edea-2fed-49f4-be67-d7f837695e08,host='devstack@QuobyteHD#QuobyteHD',id=8a7a1c90-fa2e-4319-b7dc-1073e75f005c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b7d911867f405386dcff0d413815e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:35Z,use_quota=True,user_id='225f0633c14d49c0884c90eb91e70560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50730956-edfc-41c5-b234-1e36679358a9),volume_type_id=50730956-edfc-41c5-b234-1e36679358a9)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73189706-20b7-4e6c-9101-ae4793bf6a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73189706-20b7-4e6c-9101-ae4793bf6a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c202167-c92d-43c8-b406-4639d2f85b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c202167-c92d-43c8-b406-4639d2f85b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7a1c90-fa2e-4319-b7dc-1073e75f005c', 'volume_name': 'volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87249996-1b29-4a18-9e5a-46805244b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87249996-1b29-4a18-9e5a-46805244b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2deaace-ed7f-4bbb-97ba-0d6e1e878a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:35 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Volume 8a7a1c90-fa2e-4319-b7dc-1073e75f005c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c', 'volume_size': 1} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d002edea-2fed-49f4-be67-d7f837695e08,created_at=2026-02-27T21:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936561397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d002edea-2fed-49f4-be67-d7f837695e08,host='devstack@QuobyteHD#QuobyteHD',id=8a7a1c90-fa2e-4319-b7dc-1073e75f005c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b7d911867f405386dcff0d413815e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:35Z,use_quota=True,user_id='225f0633c14d49c0884c90eb91e70560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50730956-edfc-41c5-b234-1e36679358a9),volume_type_id=50730956-edfc-41c5-b234-1e36679358a9)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Creating volume 8a7a1c90-fa2e-4319-b7dc-1073e75f005c {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:35 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:35 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c 1073741824 Feb 27 22:26:35 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:35 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764" returned: 0 in 0.641s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[10508123-472f-41e4-b90c-71d1a79d006c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:35 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a Feb 27 22:26:35 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:35 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c 1073741824" returned: 0 in 0.561s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:35 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c Feb 27 22:26:35 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:36 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a" returned: 0 in 0.541s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:36 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 Feb 27 22:26:36 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" returned: 0 in 0.576s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:36 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2deaace-ed7f-4bbb-97ba-0d6e1e878a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5acd843-7567-43df-839e-e6b280496599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:36 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Volume volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c (8a7a1c90-fa2e-4319-b7dc-1073e75f005c): created successfully Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5acd843-7567-43df-839e-e6b280496599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Flow 'volume_create_manager' (aeaa4b3b-98aa-4d17-8957-d38b0669cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:36 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b365c977-e3f7-44d7-a2fe-d9fed9222afb tempest-GroupSnapshotsTest-1553791753 None] Created volume successfully. Feb 27 22:26:36 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764" returned: 0 in 0.643s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:36 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764 Feb 27 22:26:36 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:37 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f7cab9eb-9312-412a-8ba8-7101a4815764" returned: 0 in 0.440s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-f7cab9eb-9312-412a-8ba8-7101a4815764" released by "_delete_snapshot" :: held 2.332s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" released by "delete_snapshot" :: held 2.347s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Created reservations ['867de771-f178-4ef8-9c60-c3be13d094ee', '8d587bc8-9f3d-4b46-a1c3-29b777495b55', 'cab2763d-3ba0-471f-8ab9-551d930785ed', 'abf0e5ef-974a-4902-a137-5c6d69395569'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:37 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Delete snapshot completed successfully. Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-f7cab9eb-9312-412a-8ba8-7101a4815764-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-f86cc933-5472-4dbf-8bac-03ee2369e90a-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-f86cc933-5472-4dbf-8bac-03ee2369e90a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-f86cc933-5472-4dbf-8bac-03ee2369e90a" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-f86cc933-5472-4dbf-8bac-03ee2369e90a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Deleting offline snapshot f86cc933-5472-4dbf-8bac-03ee2369e90a of volume 129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] snapshot_file for this snap is: volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a786117-0f4b-4484-93db-b2efd36a938b]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:37 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a Feb 27 22:26:37 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:37 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] GroupSnapshot cca48c66-dc53-4c3c-8222-9a52010c7008: creating. Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Group snapshot cca48c66-dc53-4c3c-8222-9a52010c7008: creating. {{(pid=83540) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4178}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Creating offline snapshot e95a6502-b331-46ca-8312-fc1bff59178a of volume 8a7a1c90-fa2e-4319-b7dc-1073e75f005c {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b8f298-fe3c-4f7c-b768-f8e8ee587d8f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:37 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c Feb 27 22:26:37 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:38 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a" returned: 0 in 0.705s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7ee906-1eb9-41c6-acbf-6cf510ff4971]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:38 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc Feb 27 22:26:38 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:38 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" returned: 0 in 0.576s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:38 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a 1G Feb 27 22:26:38 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Acquiring lock "cinder-70f6e110-48b4-4259-a7af-625b4333277f-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Lock "cinder-70f6e110-48b4-4259-a7af-625b4333277f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Acquiring lock "cinder-quobyte-70f6e110-48b4-4259-a7af-625b4333277f" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Lock "cinder-quobyte-70f6e110-48b4-4259-a7af-625b4333277f" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f990955-7c15-44e7-abe0-96b8ac7294dd]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:38 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" returned: 0 in 0.587s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:38 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a Feb 27 22:26:38 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:38 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f Feb 27 22:26:38 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:38 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a 1G" returned: 0 in 0.564s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:38 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a Feb 27 22:26:38 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:39 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f" returned: 0 in 0.553s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:39 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f Feb 27 22:26:39 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:39 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a" returned: 0 in 0.629s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:39 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a" returned: 0 in 0.554s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:39 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:26:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:39 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a Feb 27 22:26:39 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:39 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a Feb 27 22:26:39 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:39 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc.f86cc933-5472-4dbf-8bac-03ee2369e90a" returned: 0 in 0.630s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-f86cc933-5472-4dbf-8bac-03ee2369e90a" released by "_delete_snapshot" :: held 2.639s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" released by "delete_snapshot" :: held 2.655s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:40 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a" returned: 0 in 0.741s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Created reservations ['362718db-2699-486e-a0f6-1542af55b157', 'd43236ca-a222-48d1-b3fb-8ea5c28320ac', 'eeeb07a3-3e9c-46b5-8e37-d7aac84e7a20', '1221e976-7dfa-4e4a-9b00-7464059d00c2'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:40 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.info Feb 27 22:26:40 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:40 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Delete snapshot completed successfully. Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-f86cc933-5472-4dbf-8bac-03ee2369e90a-delete_snapshot" released by "delete_snapshot" :: held 2.976s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Snapshots deleted, issuing volume delete {{(pid=83540) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1013}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" acquired by "delete_volume" :: waited 0.019s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea170e00-7bfd-44e8-af6b-63b66e0211f6]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:40 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70f6e110-48b4-4259-a7af-625b4333277f" returned: 0 in 1.254s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Lock "cinder-quobyte-70f6e110-48b4-4259-a7af-625b4333277f" released by "delete_volume" :: held 1.839s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Created reservations ['4ea17cd6-f87a-415f-ad31-c7603aeb1176', '6644905f-0ab4-4abb-a0ed-01321c464103', '0fff0f90-a073-42fd-9d90-a26ca142a312', 'e186520f-eb65-44cb-9441-9e5998770da7'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:40 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc Feb 27 22:26:40 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:40 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:40 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Acquiring lock "cinder-1a06415e-5c5b-4bdf-802e-6e08be2b0c51-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:40 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:40 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Lock "cinder-1a06415e-5c5b-4bdf-802e-6e08be2b0c51-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Acquiring lock "cinder-quobyte-1a06415e-5c5b-4bdf-802e-6e08be2b0c51" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Lock "cinder-quobyte-1a06415e-5c5b-4bdf-802e-6e08be2b0c51" acquired by "delete_volume" :: waited 0.029s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f02227c-4863-4a55-a4de-61c362059aaf]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:41 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 Feb 27 22:26:41 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:41 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.info" returned: 0 in 1.229s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:41 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:41 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.info Feb 27 22:26:41 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:41 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" returned: 0 in 1.209s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:41 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc Feb 27 22:26:41 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:41 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.740s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:26:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:26:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:26:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:26:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:26:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:26:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:26:41 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.037s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:41 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Deleted volume successfully. Feb 27 22:26:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dbabe0f1-6005-46e0-92a5-88178d72e4ef tempest-VolumesListTestJSON-944436800 None] Lock "cinder-70f6e110-48b4-4259-a7af-625b4333277f-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5f85e678-b516-4514-875d-9ae8fb92b4a7 tempest-VolumesActionsTest-408327979 None] Acquiring lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2" by "attach_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5f85e678-b516-4514-875d-9ae8fb92b4a7 tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2" acquired by "attach_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5f85e678-b516-4514-875d-9ae8fb92b4a7 tempest-VolumesActionsTest-408327979 None] Attaching volume 78c01ae5-0cd7-4639-8344-52587fcb16e2 to instance c57a6721-1f91-45d7-ab6b-26ae11fe96ad at mountpoint /dev/vdb on host None. Feb 27 22:26:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5f85e678-b516-4514-875d-9ae8fb92b4a7 tempest-VolumesActionsTest-408327979 None] Attach volume completed successfully. Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5f85e678-b516-4514-875d-9ae8fb92b4a7 tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2" released by "attach_volume" :: held 0.077s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:42 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.info" returned: 0 in 0.795s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.589s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-05a488ce-d27b-4db4-b233-2a819df0232d tempest-GroupSnapshotsTest-1553791753 None] group_snapshot cca48c66-dc53-4c3c-8222-9a52010c7008: created successfully Feb 27 22:26:42 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51" returned: 0 in 1.115s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:42 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51 Feb 27 22:26:42 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:42 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" returned: 0 in 0.716s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-129478c0-d9cc-4a86-a976-fc0d08ee9bfc" released by "delete_volume" :: held 2.002s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Created reservations ['72564466-dd25-4d55-b845-ba50b57b5de9', '985dabfb-cc46-412e-a35e-fdf12c34cd21', '8acfca84-b738-4c48-a4a9-629c71c44ff4', '91f4dd82-7111-4db9-abac-cf75ec488bb1'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:42 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:42 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6026d455-3dcf-4df9-a1b6-846a52919d19 tempest-VolumesActionsTest-408327979 None] Acquiring lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-detach_volume" by "detach_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6026d455-3dcf-4df9-a1b6-846a52919d19 tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6026d455-3dcf-4df9-a1b6-846a52919d19 tempest-VolumesActionsTest-408327979 None] Detaching volume 78c01ae5-0cd7-4639-8344-52587fcb16e2 from instance c57a6721-1f91-45d7-ab6b-26ae11fe96ad. Feb 27 22:26:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6026d455-3dcf-4df9-a1b6-846a52919d19 tempest-VolumesActionsTest-408327979 None] Detach volume completed successfully. Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6026d455-3dcf-4df9-a1b6-846a52919d19 tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:42 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1a06415e-5c5b-4bdf-802e-6e08be2b0c51" returned: 0 in 0.510s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Lock "cinder-quobyte-1a06415e-5c5b-4bdf-802e-6e08be2b0c51" released by "delete_volume" :: held 1.671s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Created reservations ['87ee148a-4015-4730-8c81-7883f322e831', 'ad4314af-cc88-4c40-afe6-1f301492ab97', '2ed18f5a-18be-45ed-a19b-5a0293995704', '17b9ea46-95ef-42d4-9899-8ba05e2e65fd'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:42 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.470s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Deleted volume successfully. Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8559613b-1750-426c-bd94-fd03693dfcfc tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-129478c0-d9cc-4a86-a976-fc0d08ee9bfc-delete_volume" released by "delete_volume" :: held 8.247s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:42 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:42 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:43 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] group_snapshot cca48c66-dc53-4c3c-8222-9a52010c7008: deleting Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] group_snapshot cca48c66-dc53-4c3c-8222-9a52010c7008: deleting {{(pid=83540) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4353}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-e95a6502-b331-46ca-8312-fc1bff59178a" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-e95a6502-b331-46ca-8312-fc1bff59178a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Deleting offline snapshot e95a6502-b331-46ca-8312-fc1bff59178a of volume 8a7a1c90-fa2e-4319-b7dc-1073e75f005c {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] snapshot_file for this snap is: volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4309be51-4ca4-4515-bca7-a4a0977b8ebe]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:43 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a Feb 27 22:26:43 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Acquiring lock "cinder-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Lock "cinder-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Acquiring lock "cinder-quobyte-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Lock "cinder-quobyte-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea167d6-4be2-491a-88e8-492d6ed7cb7c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:43 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.609s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:43 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Deleted volume successfully. Feb 27 22:26:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8efcbbbd-ab6a-4e32-a728-b2001164ecae tempest-VolumesListTestJSON-944436800 None] Lock "cinder-1a06415e-5c5b-4bdf-802e-6e08be2b0c51-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:43 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 Feb 27 22:26:43 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Flow 'volume_create_manager' (7e8e7652-7fa5-4b71-aa6d-c65b44894afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80de59e5-4ef1-4fb1-8050-efd175b1b930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80de59e5-4ef1-4fb1-8050-efd175b1b930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-899495460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14eec979-f42d-4319-b868-995177a3327c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be80e4a977694822aa7c9b8fa39c43dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:44Z,use_quota=True,user_id='b3697f531b394c9289a383003ce70d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c238e8-e538-4407-83ac-dbf297f214a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c238e8-e538-4407-83ac-dbf297f214a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf7e0d3-e622-406b-beee-07dd11c5c912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf7e0d3-e622-406b-beee-07dd11c5c912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14eec979-f42d-4319-b868-995177a3327c', 'volume_name': 'volume-14eec979-f42d-4319-b868-995177a3327c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baf4726-513a-4e7b-917e-21ddd8f8442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baf4726-513a-4e7b-917e-21ddd8f8442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d048d9a-05b9-4aa9-9d92-4ce7f8c424a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Volume 14eec979-f42d-4319-b868-995177a3327c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14eec979-f42d-4319-b868-995177a3327c', 'volume_size': 1} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-899495460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14eec979-f42d-4319-b868-995177a3327c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be80e4a977694822aa7c9b8fa39c43dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:44Z,use_quota=True,user_id='b3697f531b394c9289a383003ce70d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Creating volume 14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:44 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:44 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a" returned: 0 in 1.037s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:44 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c 1073741824 Feb 27 22:26:44 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c022e1b1-0ce5-468f-9a49-8a7d1173da1f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:44 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30" returned: 0 in 0.787s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:44 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30 Feb 27 22:26:44 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:44 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c Feb 27 22:26:44 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:44 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c 1073741824" returned: 0 in 0.560s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:44 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c Feb 27 22:26:44 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:44 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30" returned: 0 in 0.550s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Lock "cinder-quobyte-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30" released by "delete_volume" :: held 1.368s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Created reservations ['ab6694dd-f03d-4a9d-8531-29c997436a70', '6e269d8b-4c3d-4036-9e26-49cabc89497e', 'b3a4dac9-a2e8-4ad2-9877-f5eb79cc71fa', 'bac4e988-5041-48f1-8732-83b6e3c40886'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:44 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" returned: 0 in 0.706s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:44 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a Feb 27 22:26:44 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:44 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:44 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:45 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c" returned: 0 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d048d9a-05b9-4aa9-9d92-4ce7f8c424a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14eec979-f42d-4319-b868-995177a3327c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c9bd96-2e74-435e-b31b-9c4dd6732b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:45 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Volume volume-14eec979-f42d-4319-b868-995177a3327c (14eec979-f42d-4319-b868-995177a3327c): created successfully Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c9bd96-2e74-435e-b31b-9c4dd6732b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Flow 'volume_create_manager' (7e8e7652-7fa5-4b71-aa6d-c65b44894afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:45 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-32390821-5a63-40f1-9f7a-9bc6a16510b3 tempest-VolumesDeleteCascade-983129995 None] Created volume successfully. Feb 27 22:26:45 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.496s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:45 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Deleted volume successfully. Feb 27 22:26:45 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3eb5244c-5ea9-49ed-8735-22a37bfcbdd4 tempest-VolumesListTestJSON-944436800 None] Lock "cinder-dd9d0954-f483-4f7b-b9e5-fb51ed33ba30-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a" returned: 0 in 0.584s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:45 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a Feb 27 22:26:45 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:46 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c.e95a6502-b331-46ca-8312-fc1bff59178a" returned: 0 in 0.594s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-e95a6502-b331-46ca-8312-fc1bff59178a" released by "_delete_snapshot" :: held 3.008s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" released by "delete_snapshot" :: held 3.024s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:46 devstack cinder-volume[83540]: WARNING cinder.quota [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1660128398 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1660128398, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:26:46 devstack cinder-volume[83540]: WARNING cinder.quota [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1660128398 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1660128398, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['cfed0eda-0f00-47ab-adcd-02e47030928c', '65d612d8-6df3-457d-9bad-f332cab00026', 'e292c415-0527-4760-90f3-df85f360f95a', '51514e8e-aefd-466a-8b6d-04e435bec47d'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-97bbde25-e4d0-4dbd-94c4-2bec032c99ab tempest-GroupSnapshotsTest-1553791753 None] group_snapshot cca48c66-dc53-4c3c-8222-9a52010c7008: deleted successfully Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Creating offline snapshot e4e823ff-f510-4883-954c-0f3f4162c84b of volume 14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd12df-2251-4579-9d2c-064aa97d6814]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:46 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c Feb 27 22:26:46 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "cinder-quobyte-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa904c-a778-4e31-9b12-cb1e827c4b49]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:46 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c Feb 27 22:26:46 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:46 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c" returned: 0 in 0.609s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:46 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b 1G Feb 27 22:26:46 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:47 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" returned: 0 in 0.721s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:47 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c Feb 27 22:26:47 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:47 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b 1G" returned: 0 in 0.578s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14eec979-f42d-4319-b868-995177a3327c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:47 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14eec979-f42d-4319-b868-995177a3327c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b Feb 27 22:26:47 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:47 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" returned: 0 in 0.526s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Lock "cinder-quobyte-8a7a1c90-fa2e-4319-b7dc-1073e75f005c" released by "delete_volume" :: held 1.283s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:47 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['2a092a38-2c63-4955-9226-5b82764e9fd4'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:47 devstack cinder-volume[83540]: WARNING cinder.quota [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1660128398 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1660128398, it is now deprecated. Please use the default quota class for default quota. Feb 27 22:26:47 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Created reservations ['511094cd-98a8-48e2-b1d9-9973af196b81', '4dcefa53-5cbd-4912-a717-618e171d686f', 'c9618378-0950-40c6-90bf-a6bb6eb9028c', '1b6f3c6d-1cab-4b25-b87e-112a72e862c8'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:48 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14eec979-f42d-4319-b868-995177a3327c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b" returned: 0 in 0.624s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:48 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b is being set with open permissions: ugo+rw Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:48 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:26:48 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:48 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b Feb 27 22:26:48 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Flow 'volume_create_manager' (b0c966cd-d2d1-4f1b-a65e-d6922db3411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03341ce5-4d70-4b67-8e3e-ccffab1800c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03341ce5-4d70-4b67-8e3e-ccffab1800c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2122566127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cd3c87-b20c-4183-80b2-30e706824afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0d035115b449d94f511a41faf9184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:48Z,use_quota=True,user_id='f7be093ca24c489b9d568d6770812c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ec03fb-67de-453f-b70b-1999aa05ee4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ec03fb-67de-453f-b70b-1999aa05ee4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3764aa55-d1f4-4403-b8d4-c7b29ddebb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3764aa55-d1f4-4403-b8d4-c7b29ddebb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11cd3c87-b20c-4183-80b2-30e706824afe', 'volume_name': 'volume-11cd3c87-b20c-4183-80b2-30e706824afe', 'volume_size': 2}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0826da7e-c492-4863-a8cd-59e819a2fd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0826da7e-c492-4863-a8cd-59e819a2fd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095c022e-9648-43d4-acb7-cba6b54fa104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:48 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Volume 11cd3c87-b20c-4183-80b2-30e706824afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11cd3c87-b20c-4183-80b2-30e706824afe', 'volume_size': 2} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:48 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b" returned: 0 in 0.437s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:48 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.506s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:48 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:26:48 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4ea92535-d768-4d15-9570-a5f31d7a120f tempest-GroupSnapshotsTest-1553791753 None] Delete group completed successfully. Feb 27 22:26:48 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.info Feb 27 22:26:48 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:49 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.info" returned: 0 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:49 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.info is being set with open permissions: ugo+rw Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:49 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.info Feb 27 22:26:49 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:49 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.info" returned: 0 in 0.520s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.331s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2122566127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cd3c87-b20c-4183-80b2-30e706824afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e0d035115b449d94f511a41faf9184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:48Z,use_quota=True,user_id='f7be093ca24c489b9d568d6770812c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Creating volume 11cd3c87-b20c-4183-80b2-30e706824afe {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:49 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe 2147483648 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:49 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe 2147483648 Feb 27 22:26:49 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:49 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-94286497-26b3-4384-9025-c09a1abe1c47 tempest-VolumesDeleteCascade-983129995 None] Create snapshot completed successfully Feb 27 22:26:50 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe 2147483648" returned: 0 in 0.636s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:50 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe Feb 27 22:26:50 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Flow 'volume_create_manager' (40f46495-00c0-451d-8fb5-2d1052973a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de98564-7140-4125-8e4a-7ff7ceb52892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de98564-7140-4125-8e4a-7ff7ceb52892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1287158787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43b401e-b84a-4241-93dc-5700b2b7070b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be80e4a977694822aa7c9b8fa39c43dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4e823ff-f510-4883-954c-0f3f4162c84b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:51Z,use_quota=True,user_id='b3697f531b394c9289a383003ce70d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36824e9c-537f-4167-88dc-076de4407646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36824e9c-537f-4167-88dc-076de4407646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd96ef65-83a2-4073-86dc-174933a1b2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd96ef65-83a2-4073-86dc-174933a1b2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b43b401e-b84a-4241-93dc-5700b2b7070b', 'volume_name': 'volume-b43b401e-b84a-4241-93dc-5700b2b7070b', 'volume_size': 1, 'snapshot_id': 'e4e823ff-f510-4883-954c-0f3f4162c84b'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fbd072-87ed-4337-8b36-e587be161b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fbd072-87ed-4337-8b36-e587be161b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d7f6e5-4f44-456d-945c-c9bc33eafa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:50 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Volume b43b401e-b84a-4241-93dc-5700b2b7070b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b43b401e-b84a-4241-93dc-5700b2b7070b', 'volume_size': 1, 'snapshot_id': 'e4e823ff-f510-4883-954c-0f3f4162c84b'} Feb 27 22:26:50 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe" returned: 0 in 0.676s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:50 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-e4e823ff-f510-4883-954c-0f3f4162c84b-b43b401e-b84a-4241-93dc-5700b2b7070b" by "_create_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095c022e-9648-43d4-acb7-cba6b54fa104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11cd3c87-b20c-4183-80b2-30e706824afe', 'volume_size': 2}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99612988-2008-4f37-a80c-6f584ee368ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:51 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Volume volume-11cd3c87-b20c-4183-80b2-30e706824afe (11cd3c87-b20c-4183-80b2-30e706824afe): created successfully Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99612988-2008-4f37-a80c-6f584ee368ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Flow 'volume_create_manager' (b0c966cd-d2d1-4f1b-a65e-d6922db3411e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:51 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1f3de0c1-6c88-4824-be91-dcca3ac878a1 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Created volume successfully. Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-e4e823ff-f510-4883-954c-0f3f4162c84b-b43b401e-b84a-4241-93dc-5700b2b7070b" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Creating volume b43b401e-b84a-4241-93dc-5700b2b7070b from snapshot e4e823ff-f510-4883-954c-0f3f4162c84b {{(pid=83540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-b43b401e-b84a-4241-93dc-5700b2b7070b" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-b43b401e-b84a-4241-93dc-5700b2b7070b" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] snapshot: e4e823ff-f510-4883-954c-0f3f4162c84b, volume: b43b401e-b84a-4241-93dc-5700b2b7070b, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6f16f9-e294-45e8-abb1-884b0ea45ecd]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:51 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b Feb 27 22:26:51 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:51 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b" returned: 0 in 0.559s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14eec979-f42d-4319-b868-995177a3327c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e17d59-e4bf-4a5d-ac23-8aa5a3ee51e6]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:51 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c Feb 27 22:26:51 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:52 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c" returned: 0 in 0.577s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:52 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:26:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:52 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b Feb 27 22:26:52 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:54 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b" returned: 0 in 2.387s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:54 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[88979e75-ebe2-481a-94a3-d798e954f121]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:54 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c Feb 27 22:26:54 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:55 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c" returned: 0 in 0.726s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:26:55 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Converted 1024.00 MB image at 428.77 MB/s Feb 27 22:26:55 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b is being set with open permissions: ugo+rw Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:55 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b Feb 27 22:26:55 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:55 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b" returned: 0 in 0.476s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-b43b401e-b84a-4241-93dc-5700b2b7070b" released by "_copy_volume_from_snapshot" :: held 4.790s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-e4e823ff-f510-4883-954c-0f3f4162c84b-b43b401e-b84a-4241-93dc-5700b2b7070b" released by "_create_volume_from_snapshot" :: held 4.810s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.853s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.302s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Creating offline snapshot 7ff19f6b-bcbe-46ce-800a-87d502584fac of volume 11cd3c87-b20c-4183-80b2-30e706824afe {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d7f6e5-4f44-456d-945c-c9bc33eafa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43b401e-b84a-4241-93dc-5700b2b7070b', 'volume_size': 1, 'snapshot_id': 'e4e823ff-f510-4883-954c-0f3f4162c84b'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a437061d-cac1-4ffb-9dbc-64a46a474c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31db1b-703f-4931-8311-d9de2dc5e12f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:55 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Volume volume-b43b401e-b84a-4241-93dc-5700b2b7070b (b43b401e-b84a-4241-93dc-5700b2b7070b): created successfully Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a437061d-cac1-4ffb-9dbc-64a46a474c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Flow 'volume_create_manager' (40f46495-00c0-451d-8fb5-2d1052973a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:55 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-bf112ea2-5045-4980-ad2b-b7406e606e3e tempest-VolumesDeleteCascade-983129995 None] Created volume successfully. Feb 27 22:26:55 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe Feb 27 22:26:55 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-14eec979-f42d-4319-b868-995177a3327c-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-14eec979-f42d-4319-b868-995177a3327c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Performing cascade delete. {{(pid=83540) delete_volume /opt/stack/cinder/cinder/volume/manager.py:998}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-e4e823ff-f510-4883-954c-0f3f4162c84b-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-e4e823ff-f510-4883-954c-0f3f4162c84b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-14eec979-f42d-4319-b868-995177a3327c" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-14eec979-f42d-4319-b868-995177a3327c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-e4e823ff-f510-4883-954c-0f3f4162c84b" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-e4e823ff-f510-4883-954c-0f3f4162c84b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Deleting offline snapshot e4e823ff-f510-4883-954c-0f3f4162c84b of volume 14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] snapshot_file for this snap is: volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90ad80c-d5a1-480a-b72c-08fc0ca0f873]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:56 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe" returned: 0 in 0.746s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac 2G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:56 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac 2G Feb 27 22:26:56 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:56 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b Feb 27 22:26:56 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:57 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b" returned: 0 in 0.613s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14eec979-f42d-4319-b868-995177a3327c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da3368-9796-4579-8709-4bcac01dcee4]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:57 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac 2G" returned: 0 in 0.689s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11cd3c87-b20c-4183-80b2-30e706824afe -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:57 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c Feb 27 22:26:57 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:57 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11cd3c87-b20c-4183-80b2-30e706824afe -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac Feb 27 22:26:57 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Flow 'volume_create_manager' (eb514970-0d73-434c-9cdc-526cb54015b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4b89f9-7db8-420b-a7f1-c5695b5c02a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4b89f9-7db8-420b-a7f1-c5695b5c02a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1281978185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d8e96d-9b29-48dd-84a4-9d646c2626bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0bbc45c1dd4de8b9ced2516557d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:58Z,use_quota=True,user_id='ccdc7d39018346b6bbef1703d2e65d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d81986-af09-4a5b-b72f-cdb38adfaeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d81986-af09-4a5b-b72f-cdb38adfaeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44805c22-b315-4ac6-8931-4bb7a2565849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44805c22-b315-4ac6-8931-4bb7a2565849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d8e96d-9b29-48dd-84a4-9d646c2626bc', 'volume_name': 'volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c773be9c-3a4f-47b9-a693-69452a4d8dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c773be9c-3a4f-47b9-a693-69452a4d8dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0a1f9c-42fe-4d39-8c3c-b032633d4e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:26:57 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc', 'volume_size': 1} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:57 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c" returned: 0 in 0.597s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:57 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b Feb 27 22:26:57 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:57 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11cd3c87-b20c-4183-80b2-30e706824afe -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac" returned: 0 in 0.530s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:57 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac is being set with open permissions: ugo+rw Feb 27 22:26:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:57 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac Feb 27 22:26:57 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:58 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac" returned: 0 in 0.419s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:58 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b" returned: 0 in 0.481s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:58 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b Feb 27 22:26:58 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:58 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.info Feb 27 22:26:58 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:58 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.info" returned: 0 in 0.453s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:58 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.info is being set with open permissions: ugo+rw Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:58 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c.e4e823ff-f510-4883-954c-0f3f4162c84b" returned: 0 in 0.491s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-e4e823ff-f510-4883-954c-0f3f4162c84b" released by "_delete_snapshot" :: held 2.248s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:58 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.info Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-14eec979-f42d-4319-b868-995177a3327c" released by "delete_snapshot" :: held 2.263s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:58 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Created reservations ['2da8550c-6f21-498f-bfb6-bb475cb902be', 'fab1e990-d036-4cdf-b3fa-92790fc48ba0', '26380663-052f-4529-acb7-3629c7843f3d', 'f68e6277-9630-4c1b-b404-d160d733f6ba'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:26:58 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Delete snapshot completed successfully. Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-e4e823ff-f510-4883-954c-0f3f4162c84b-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Snapshots deleted, issuing volume delete {{(pid=83540) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1013}} Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-14eec979-f42d-4319-b868-995177a3327c" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-14eec979-f42d-4319-b868-995177a3327c" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ec1b4b-3bd4-41b3-95b0-6c4b061aa0f4]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:58 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c Feb 27 22:26:58 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:59 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.info" returned: 0 in 0.439s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.383s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1281978185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d8e96d-9b29-48dd-84a4-9d646c2626bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0bbc45c1dd4de8b9ced2516557d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:26:58Z,use_quota=True,user_id='ccdc7d39018346b6bbef1703d2e65d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Creating volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:26:59 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:59 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc 1073741824 Feb 27 22:26:59 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5370ef87-8844-463c-a43a-8feb704aee27 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Create snapshot completed successfully Feb 27 22:26:59 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c" returned: 0 in 0.487s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:59 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c Feb 27 22:26:59 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:59 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc 1073741824" returned: 0 in 0.584s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "cinder-7ff19f6b-bcbe-46ce-800a-87d502584fac-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-7ff19f6b-bcbe-46ce-800a-87d502584fac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "cinder-quobyte-11cd3c87-b20c-4183-80b2-30e706824afe" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:59 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc Feb 27 22:26:59 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:26:59 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-quobyte-11cd3c87-b20c-4183-80b2-30e706824afe" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "cinder-quobyte-7ff19f6b-bcbe-46ce-800a-87d502584fac" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-14eec979-f42d-4319-b868-995177a3327c" returned: 0 in 0.515s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-quobyte-7ff19f6b-bcbe-46ce-800a-87d502584fac" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Deleting offline snapshot 7ff19f6b-bcbe-46ce-800a-87d502584fac of volume 11cd3c87-b20c-4183-80b2-30e706824afe {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] snapshot_file for this snap is: volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-14eec979-f42d-4319-b868-995177a3327c" released by "delete_volume" :: held 1.067s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de6ee05-2be4-4a83-af8e-67c90c150643]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:26:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Created reservations ['7f4c4ec5-3adb-4582-94ba-f0d0bdc8d549', 'eb8a2c41-2b81-424e-8171-41eb083027d4', 'ab556de7-c810-4022-92ff-17d93d46940d', '48ba586c-d99f-4306-9a82-3e912c6f81fc'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:00 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:00 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:00 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:00 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:00 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc" returned: 0 in 0.436s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0a1f9c-42fe-4d39-8c3c-b032633d4e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f52a08-3805-4bce-9b35-a9e8bf00edaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:00 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Volume volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc (10d8e96d-9b29-48dd-84a4-9d646c2626bc): created successfully Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f52a08-3805-4bce-9b35-a9e8bf00edaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Flow 'volume_create_manager' (eb514970-0d73-434c-9cdc-526cb54015b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-82c25cd8-a7a3-42c5-a3f9-21a32677e2a5 tempest-SnapshotsActionsTest-673607108 None] Created volume successfully. Feb 27 22:27:00 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.414s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Deleted volume successfully. Feb 27 22:27:00 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac" returned: 0 in 0.507s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11cd3c87-b20c-4183-80b2-30e706824afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc45a26-6640-4d8d-a2b7-6ee738150a15]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5907c2cd-b3ac-4a26-a995-0f3ebf6108cb tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-14eec979-f42d-4319-b868-995177a3327c-delete_volume" released by "delete_volume" :: held 4.086s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:00 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe Feb 27 22:27:00 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-b43b401e-b84a-4241-93dc-5700b2b7070b-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-b43b401e-b84a-4241-93dc-5700b2b7070b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Creating offline snapshot 40218355-04b6-4cb3-b715-e518c6cf7a3c of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e268d054-834f-4168-97ca-cd271b6910d9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "cinder-quobyte-b43b401e-b84a-4241-93dc-5700b2b7070b" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-b43b401e-b84a-4241-93dc-5700b2b7070b" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[46834729-f48a-41b1-bb91-5b1d465649ef]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:01 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe" returned: 0 in 0.594s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:01 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc Feb 27 22:27:01 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:01 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac Feb 27 22:27:01 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:01 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b Feb 27 22:27:01 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:01 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc" returned: 0 in 0.775s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:01 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c 1G Feb 27 22:27:01 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:01 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b" returned: 0 in 0.885s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:01 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac" returned: 0 in 0.897s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:02 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b Feb 27 22:27:02 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:02 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac Feb 27 22:27:02 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:02 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c 1G" returned: 0 in 0.890s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:02 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:02 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:02 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b43b401e-b84a-4241-93dc-5700b2b7070b" returned: 0 in 0.771s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-quobyte-b43b401e-b84a-4241-93dc-5700b2b7070b" released by "delete_volume" :: held 1.704s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=193,cinder:UPDATE=232,cinder:INSERT=56,cinder:DELETE=14 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Created reservations ['233eafb8-a47f-4efa-aeb7-f630c1e05104', '69b8e58f-a9ae-4f97-9c03-435636a573dc', '7be72b03-9dbd-4cf4-8116-ffdbf701f4df', 'b909b939-3abb-41e4-9ba7-60c4a235aab6'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:02 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe.7ff19f6b-bcbe-46ce-800a-87d502584fac" returned: 0 in 0.825s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-quobyte-7ff19f6b-bcbe-46ce-800a-87d502584fac" released by "_delete_snapshot" :: held 2.915s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-quobyte-11cd3c87-b20c-4183-80b2-30e706824afe" released by "delete_snapshot" :: held 2.950s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:02 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Created reservations ['a31998d7-3664-4b2d-9a95-90011256caba', '7831b35b-2e70-4a17-95a3-5bd2adccd8ef', 'ad27dad6-d84a-4b6f-810a-62ac9fb9735c', '2777b347-2c89-4206-8da5-b3c3d2a84216'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:02 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:02 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Delete snapshot completed successfully. Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-27ec8faa-3d04-4d54-8bde-dc893a97c0b0 tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-7ff19f6b-bcbe-46ce-800a-87d502584fac-delete_snapshot" released by "delete_snapshot" :: held 3.182s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:03 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.527s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:03 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c is being set with open permissions: ugo+rw Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "cinder-11cd3c87-b20c-4183-80b2-30e706824afe-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-11cd3c87-b20c-4183-80b2-30e706824afe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:03 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:03 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "cinder-quobyte-11cd3c87-b20c-4183-80b2-30e706824afe" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-quobyte-11cd3c87-b20c-4183-80b2-30e706824afe" acquired by "delete_volume" :: waited 0.035s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2358e960-13d1-4b44-a4d4-f3474745ba94]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:03 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.571s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Deleted volume successfully. Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-908da31f-7524-4588-8d43-0a6c9c25119e tempest-VolumesDeleteCascade-983129995 None] Lock "cinder-b43b401e-b84a-4241-93dc-5700b2b7070b-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:03 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe Feb 27 22:27:03 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-94851f8b-94c6-4a02-b738-d3d5661671c6 tempest-VolumesActionsTest-408327979 None] Acquiring lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2" by "attach_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-94851f8b-94c6-4a02-b738-d3d5661671c6 tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2" acquired by "attach_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:03 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.715s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-94851f8b-94c6-4a02-b738-d3d5661671c6 tempest-VolumesActionsTest-408327979 None] Attaching volume 78c01ae5-0cd7-4639-8344-52587fcb16e2 to instance dc165b69-ecb4-4ba9-9f2f-ce09f21c52f3 at mountpoint /dev/vdb on host None. Feb 27 22:27:04 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.info Feb 27 22:27:04 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-94851f8b-94c6-4a02-b738-d3d5661671c6 tempest-VolumesActionsTest-408327979 None] Attach volume completed successfully. Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-94851f8b-94c6-4a02-b738-d3d5661671c6 tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2" released by "attach_volume" :: held 0.136s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:04 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe" returned: 0 in 0.826s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:04 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe Feb 27 22:27:04 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-878d9ff5-ff78-44fc-aa2b-61c2c48b4b1c tempest-VolumesActionsTest-408327979 None] Acquiring lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-detach_volume" by "detach_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-878d9ff5-ff78-44fc-aa2b-61c2c48b4b1c tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-878d9ff5-ff78-44fc-aa2b-61c2c48b4b1c tempest-VolumesActionsTest-408327979 None] Detaching volume 78c01ae5-0cd7-4639-8344-52587fcb16e2 from instance dc165b69-ecb4-4ba9-9f2f-ce09f21c52f3. Feb 27 22:27:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-878d9ff5-ff78-44fc-aa2b-61c2c48b4b1c tempest-VolumesActionsTest-408327979 None] Detach volume completed successfully. Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-878d9ff5-ff78-44fc-aa2b-61c2c48b4b1c tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:04 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.info" returned: 0 in 0.752s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:04 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.info is being set with open permissions: ugo+rw Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:04 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.info Feb 27 22:27:04 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:04 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-11cd3c87-b20c-4183-80b2-30e706824afe" returned: 0 in 0.646s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-quobyte-11cd3c87-b20c-4183-80b2-30e706824afe" released by "delete_volume" :: held 1.526s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Created reservations ['15994e26-aaf3-42b7-b18d-ad1f98082d00', '1dec7151-0fed-4888-94ea-0484dc1ef87b', 'dddabb60-ac80-4bdd-ba48-9c35e004cda8', '791723aa-d0bc-4acb-bf3c-8243649cd1b3'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:04 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:04 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:05 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.info" returned: 0 in 0.640s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.385s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:05 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ec44397f-6c4b-4858-a4f8-159354fb60ae tempest-SnapshotsActionsTest-673607108 None] Create snapshot completed successfully Feb 27 22:27:05 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.663s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:05 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Deleted volume successfully. Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b43515d-8a37-4a77-9e96-7cfc33d9fb0f tempest-VolumesSnapshotNegativeTestJSON-1719848754 None] Lock "cinder-11cd3c87-b20c-4183-80b2-30e706824afe-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (47f84764-d12b-4376-881b-ce8c96bae115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a93cb1-961c-4eae-bc75-13fb75f79203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a93cb1-961c-4eae-bc75-13fb75f79203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1147214608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a150fd-1171-409c-9358-0da35ebfaf47,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:06Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea90a31c-ede1-4ec9-8525-830dc3056a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea90a31c-ede1-4ec9-8525-830dc3056a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec7d08a-2ff7-4eb6-b8e6-af4ca094158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec7d08a-2ff7-4eb6-b8e6-af4ca094158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a150fd-1171-409c-9358-0da35ebfaf47', 'volume_name': 'volume-f2a150fd-1171-409c-9358-0da35ebfaf47', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cad68e1-e5f3-4fe2-ae25-4af513471053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cad68e1-e5f3-4fe2-ae25-4af513471053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11edf227-df38-4b79-bab4-2c692adc2ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:05 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Volume f2a150fd-1171-409c-9358-0da35ebfaf47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a150fd-1171-409c-9358-0da35ebfaf47', 'volume_size': 1} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1147214608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a150fd-1171-409c-9358-0da35ebfaf47,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:06Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Creating volume f2a150fd-1171-409c-9358-0da35ebfaf47 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:27:05 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:27:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:05 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 1073741824 Feb 27 22:27:05 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:06 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 1073741824" returned: 0 in 0.849s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:06 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 Feb 27 22:27:06 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:07 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47" returned: 0 in 0.491s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.603s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11edf227-df38-4b79-bab4-2c692adc2ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a150fd-1171-409c-9358-0da35ebfaf47', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7ff30e-1d44-4b66-a326-f8523ead8178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Creating offline snapshot 5315ac5b-0d7d-4077-9655-c288d33236bd of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:27:07 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Volume volume-f2a150fd-1171-409c-9358-0da35ebfaf47 (f2a150fd-1171-409c-9358-0da35ebfaf47): created successfully Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7ff30e-1d44-4b66-a326-f8523ead8178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (47f84764-d12b-4376-881b-ce8c96bae115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afd762-0671-4236-8cb4-c045b4c4ee83]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:07 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-440f53a8-f95a-45ac-9460-5e82ec2b005e tempest-VolumesGetTest-194305358 None] Created volume successfully. Feb 27 22:27:07 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:07 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Flow 'volume_create_manager' (e6bb5fa5-7cc6-40b3-b456-50e0ed75841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9456fde-dea6-414a-9b6f-0b62fc933424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9456fde-dea6-414a-9b6f-0b62fc933424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd26934-99cb-4e7a-a7a8-64da78230f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa558bbe2c542b297fcebd2810da0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:08Z,use_quota=True,user_id='1a1f846961d34e74b08556fae713e242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b600972c-76a1-4714-a049-e3697b6370f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b600972c-76a1-4714-a049-e3697b6370f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b32eede-b1f9-489f-beab-99afb21d04e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b32eede-b1f9-489f-beab-99afb21d04e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd26934-99cb-4e7a-a7a8-64da78230f7c', 'volume_name': 'volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f249078d-173d-449f-bb33-2c5d4eee712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f249078d-173d-449f-bb33-2c5d4eee712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb7f191-3691-460c-b251-8d28f276ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:07 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Volume 2fd26934-99cb-4e7a-a7a8-64da78230f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c', 'volume_size': 1} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:07 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.550s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:07 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd 1G Feb 27 22:27:07 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (546f9e95-b120-43c9-a971-0e945daa2588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e23cab-0c12-414d-98f7-30b643a41d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e23cab-0c12-414d-98f7-30b643a41d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1457379023',display_name='tempest-VolumesGetTest-Volume-470496413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf839032-374b-4a6e-9f38-a947c240f82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:08Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff785bd9-eda3-470e-8622-149e230dcb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff785bd9-eda3-470e-8622-149e230dcb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:08 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5cd62b-4715-4863-aeed-b787d3c816c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5cd62b-4715-4863-aeed-b787d3c816c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf839032-374b-4a6e-9f38-a947c240f82d', 'volume_name': 'volume-cf839032-374b-4a6e-9f38-a947c240f82d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9c5085-684a-4955-8c8a-29f79f4d51f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9c5085-684a-4955-8c8a-29f79f4d51f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde3e966-e95f-42f0-a7d9-99dc85597515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:08 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Volume cf839032-374b-4a6e-9f38-a947c240f82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf839032-374b-4a6e-9f38-a947c240f82d', 'volume_size': 1} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd 1G" returned: 0 in 0.634s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:08 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd Feb 27 22:27:08 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:09 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd" returned: 0 in 0.450s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:09 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd is being set with open permissions: ugo+rw Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:09 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd Feb 27 22:27:09 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:09 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd" returned: 0 in 0.409s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd26934-99cb-4e7a-a7a8-64da78230f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa558bbe2c542b297fcebd2810da0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:08Z,use_quota=True,user_id='1a1f846961d34e74b08556fae713e242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Creating volume 2fd26934-99cb-4e7a-a7a8-64da78230f7c {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:27:09 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:09 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c 1073741824 Feb 27 22:27:09 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:09 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f6865d9d-25fc-4f49-b187-849964473d56 tempest-SnapshotsActionsTest-673607108 None] Create snapshot completed successfully Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-5315ac5b-0d7d-4077-9655-c288d33236bd-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-5315ac5b-0d7d-4077-9655-c288d33236bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-quobyte-5315ac5b-0d7d-4077-9655-c288d33236bd" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-5315ac5b-0d7d-4077-9655-c288d33236bd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Deleting offline snapshot 5315ac5b-0d7d-4077-9655-c288d33236bd of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] snapshot_file for this snap is: volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e93e96-d9a9-48be-a173-d9b455ceaae0]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:09 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c 1073741824" returned: 0 in 0.548s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:10 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd Feb 27 22:27:10 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:10 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c Feb 27 22:27:10 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:10 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd" returned: 0 in 0.499s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c28f70-d5f1-4520-9c34-809a81d6148b]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:10 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c" returned: 0 in 0.479s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.952s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1457379023',display_name='tempest-VolumesGetTest-Volume-470496413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf839032-374b-4a6e-9f38-a947c240f82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:08Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Creating volume cf839032-374b-4a6e-9f38-a947c240f82d {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:27:10 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb7f191-3691-460c-b251-8d28f276ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:10 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:10 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63134b55-1e2e-4776-82e6-67c622741565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:10 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Volume volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c (2fd26934-99cb-4e7a-a7a8-64da78230f7c): created successfully Feb 27 22:27:10 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d 1073741824 Feb 27 22:27:10 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63134b55-1e2e-4776-82e6-67c622741565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Flow 'volume_create_manager' (e6bb5fa5-7cc6-40b3-b456-50e0ed75841d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:10 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4e81400f-77a4-4021-8227-92a04bd04bfa tempest-CinderUnicodeTest-439798692 None] Created volume successfully. Feb 27 22:27:10 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.550s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:11 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd Feb 27 22:27:11 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:11 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d 1073741824" returned: 0 in 0.615s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:11 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d Feb 27 22:27:11 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Flow 'volume_create_manager' (4f7bd194-c360-4518-9425-567bfd5644bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1f2f0-5809-42df-915b-c6798ecfa25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1f2f0-5809-42df-915b-c6798ecfa25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1970902845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0238688c-673e-4838-a16f-cdf6d30a2f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa558bbe2c542b297fcebd2810da0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:11Z,use_quota=True,user_id='1a1f846961d34e74b08556fae713e242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496ff2cd-8016-4951-9026-1d1ce9f7d755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496ff2cd-8016-4951-9026-1d1ce9f7d755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9377255-d5d3-40ad-97b6-65d0cddb68e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9377255-d5d3-40ad-97b6-65d0cddb68e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0238688c-673e-4838-a16f-cdf6d30a2f43', 'volume_name': 'volume-0238688c-673e-4838-a16f-cdf6d30a2f43', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d89f247-be7c-4d8f-b411-3ac5054a3598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d89f247-be7c-4d8f-b411-3ac5054a3598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6721073-86c5-4da9-81ac-0b3dd3048176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:11 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Volume 0238688c-673e-4838-a16f-cdf6d30a2f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0238688c-673e-4838-a16f-cdf6d30a2f43', 'volume_size': 1} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:11 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd" returned: 0 in 0.540s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:11 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd Feb 27 22:27:11 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:11 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d" returned: 0 in 0.504s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1970902845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0238688c-673e-4838-a16f-cdf6d30a2f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa558bbe2c542b297fcebd2810da0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:11Z,use_quota=True,user_id='1a1f846961d34e74b08556fae713e242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Creating volume 0238688c-673e-4838-a16f-cdf6d30a2f43 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:27:11 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:11 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 1073741824 Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde3e966-e95f-42f0-a7d9-99dc85597515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf839032-374b-4a6e-9f38-a947c240f82d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:11 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462f1a4b-0d7f-41ec-ae83-24d3e5003966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:11 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Volume volume-cf839032-374b-4a6e-9f38-a947c240f82d (cf839032-374b-4a6e-9f38-a947c240f82d): created successfully Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462f1a4b-0d7f-41ec-ae83-24d3e5003966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (546f9e95-b120-43c9-a971-0e945daa2588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-eaa8952b-b4dc-4d74-89b6-d5ce76ed7f85 tempest-VolumesGetTest-194305358 None] Created volume successfully. Feb 27 22:27:11 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.5315ac5b-0d7d-4077-9655-c288d33236bd" returned: 0 in 0.436s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-5315ac5b-0d7d-4077-9655-c288d33236bd" released by "_delete_snapshot" :: held 2.101s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" released by "delete_snapshot" :: held 2.118s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Created reservations ['e7a3cf95-30f0-47f8-a3a2-d7b64928088e', '1a6cb320-cc48-479f-a70a-affa5aaa75c3', '3e701c7d-62ce-419d-a87d-21cba36596b8', 'a78677f1-c90e-4998-83aa-ba7e3598cc1a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:12 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Delete snapshot completed successfully. Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f11275a4-513b-4fd0-b40c-940410484d76 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-5315ac5b-0d7d-4077-9655-c288d33236bd-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:12 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 1073741824" returned: 0 in 0.524s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:12 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 Feb 27 22:27:12 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:12 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6721073-86c5-4da9-81ac-0b3dd3048176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0238688c-673e-4838-a16f-cdf6d30a2f43', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d54155b-5096-4cbf-8ab4-685742a62dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:12 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Volume volume-0238688c-673e-4838-a16f-cdf6d30a2f43 (0238688c-673e-4838-a16f-cdf6d30a2f43): created successfully Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d54155b-5096-4cbf-8ab4-685742a62dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Flow 'volume_create_manager' (4f7bd194-c360-4518-9425-567bfd5644bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:12 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2d2e9890-003b-4ff2-8248-e0c40767d7f1 tempest-CinderUnicodeTest-439798692 None] Created volume successfully. Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-cf839032-374b-4a6e-9f38-a947c240f82d-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Lock "cinder-cf839032-374b-4a6e-9f38-a947c240f82d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-cf839032-374b-4a6e-9f38-a947c240f82d" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-cf839032-374b-4a6e-9f38-a947c240f82d" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8d12c1-5b43-4e82-b98b-d9a970b9c5e0]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:12 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d Feb 27 22:27:12 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Creating offline snapshot ccf6d69d-5286-4863-b7de-7f33da6bfc03 of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a12e0c-ae8a-4e11-a026-cbc4939943d2]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:13 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d" returned: 0 in 0.566s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:13 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:13 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:13 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d Feb 27 22:27:13 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:13 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cf839032-374b-4a6e-9f38-a947c240f82d" returned: 0 in 0.462s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-cf839032-374b-4a6e-9f38-a947c240f82d" released by "delete_volume" :: held 1.062s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Created reservations ['a027ae5d-731b-45bb-b4d4-6a91874254b4', '56b2a1bb-7cb2-4290-8e59-370d5e3b1973', '903fc2d1-7ef9-4fc1-a999-56e5adc0fa04', '91a40c40-4fc7-4cd0-85b9-34a5bb4647df'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:14 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:14 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:14 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.660s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:14 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 1G Feb 27 22:27:14 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:14 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.428s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:14 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Deleted volume successfully. Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b6ba93e6-9569-4ca6-82a5-9ff8ba7776a2 tempest-VolumesGetTest-194305358 None] Lock "cinder-cf839032-374b-4a6e-9f38-a947c240f82d-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:14 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 1G" returned: 0 in 0.541s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:14 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 Feb 27 22:27:14 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-f2a150fd-1171-409c-9358-0da35ebfaf47-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:15 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03" returned: 0 in 0.473s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:15 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 is being set with open permissions: ugo+rw Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Lock "cinder-f2a150fd-1171-409c-9358-0da35ebfaf47-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:15 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 Feb 27 22:27:15 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-f2a150fd-1171-409c-9358-0da35ebfaf47" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-f2a150fd-1171-409c-9358-0da35ebfaf47" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff5d596-6d78-4e05-947d-81d7bd98492a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:15 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 Feb 27 22:27:15 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:15 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03" returned: 0 in 0.424s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.909s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Creating offline snapshot c8ed1bc5-6f10-40b5-9bed-49b349497c62 of volume 0238688c-673e-4838-a16f-cdf6d30a2f43 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:27:15 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-31422b04-e841-4566-81c1-1a2d8f3bc891 tempest-SnapshotsActionsTest-673607108 None] Create snapshot completed successfully Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[736254b7-5a17-4e2c-ac3c-52b5af912360]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:15 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 Feb 27 22:27:15 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:15 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47" returned: 0 in 0.561s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:15 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47 Feb 27 22:27:15 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:16 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43" returned: 0 in 0.557s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:16 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 1G Feb 27 22:27:16 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:16 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f2a150fd-1171-409c-9358-0da35ebfaf47" returned: 0 in 0.448s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-f2a150fd-1171-409c-9358-0da35ebfaf47" released by "delete_volume" :: held 1.033s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Created reservations ['0464640f-2e64-4bc5-b4c8-f6e9e0e2328b', 'a9c50d57-ef17-4e37-a36f-6d7d2a58f134', 'f9ac0882-ab06-4c96-a5f1-3035f36dc029', '72b92a17-91c2-42f3-b2a3-9201bcdae3e1'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:16 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:16 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-ccf6d69d-5286-4863-b7de-7f33da6bfc03-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-ccf6d69d-5286-4863-b7de-7f33da6bfc03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-quobyte-ccf6d69d-5286-4863-b7de-7f33da6bfc03" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-ccf6d69d-5286-4863-b7de-7f33da6bfc03" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Deleting offline snapshot ccf6d69d-5286-4863-b7de-7f33da6bfc03 of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] snapshot_file for this snap is: volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe325f2-aa7f-402c-afac-0b16e779958c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:16 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 1G" returned: 0 in 0.533s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0238688c-673e-4838-a16f-cdf6d30a2f43 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:16 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0238688c-673e-4838-a16f-cdf6d30a2f43 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 Feb 27 22:27:16 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:16 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 Feb 27 22:27:16 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:16 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.479s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:16 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Deleted volume successfully. Feb 27 22:27:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-bb69a1f8-d299-42a4-9b49-e458e2156a54 tempest-VolumesGetTest-194305358 None] Lock "cinder-f2a150fd-1171-409c-9358-0da35ebfaf47-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:17 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0238688c-673e-4838-a16f-cdf6d30a2f43 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62" returned: 0 in 0.439s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:17 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 is being set with open permissions: ugo+rw Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:17 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:17 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 Feb 27 22:27:17 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03" returned: 0 in 0.513s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b1d12-3534-42be-8d01-151f2dbb57c0]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:17 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:17 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (6bd375d8-c281-41e9-bad1-4b51e98ea288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bec46b-90c0-478e-950e-a04c6fb51d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:17 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62" returned: 0 in 0.443s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bec46b-90c0-478e-950e-a04c6fb51d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2113503660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3180e14-7681-43f2-8973-f1c6a0c15d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:17Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b123fc-2c12-4666-8dcc-b67cafd4ffb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b123fc-2c12-4666-8dcc-b67cafd4ffb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f08ca9-8ff8-4281-83ee-09e23cdf405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f08ca9-8ff8-4281-83ee-09e23cdf405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3180e14-7681-43f2-8973-f1c6a0c15d7a', 'volume_name': 'volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9154bf1a-044d-4ce5-b0d0-f7386401cb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9154bf1a-044d-4ce5-b0d0-f7386401cb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab1c149-4c90-441d-96bd-14b86d7a9688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Volume a3180e14-7681-43f2-8973-f1c6a0c15d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a', 'volume_size': 1} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:17 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.info Feb 27 22:27:17 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:17 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.505s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:17 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 Feb 27 22:27:17 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:18 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.info" returned: 0 in 0.448s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:18 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.info is being set with open permissions: ugo+rw Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:18 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.info Feb 27 22:27:18 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:18 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03" returned: 0 in 0.482s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:18 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03 Feb 27 22:27:18 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:18 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.info" returned: 0 in 0.432s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.353s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b512f5ba-36de-405a-b1d6-4c41e9ff6501]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:18 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d18f908a-82f4-4915-9c5b-1e8e58087655 tempest-CinderUnicodeTest-439798692 None] Create snapshot completed successfully Feb 27 22:27:18 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.ccf6d69d-5286-4863-b7de-7f33da6bfc03" returned: 0 in 0.413s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-ccf6d69d-5286-4863-b7de-7f33da6bfc03" released by "_delete_snapshot" :: held 1.965s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" released by "delete_snapshot" :: held 1.979s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:18 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Created reservations ['30ecad27-fa7a-4213-a255-d2f86dcaf6fa', '0429f8cb-c062-45a1-abfa-83979f3c0d7a', '1ea6ac79-7861-4222-9cf7-ee2ccaebb1e8', '54a64dbf-7ba7-43ca-9de9-ee59522541fa'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:18 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:18 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Delete snapshot completed successfully. Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9cd30105-2097-49f1-8042-5c5c9b9ee1fa tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-ccf6d69d-5286-4863-b7de-7f33da6bfc03-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Acquiring lock "cinder-c8ed1bc5-6f10-40b5-9bed-49b349497c62-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Lock "cinder-c8ed1bc5-6f10-40b5-9bed-49b349497c62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Acquiring lock "cinder-quobyte-0238688c-673e-4838-a16f-cdf6d30a2f43" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Lock "cinder-quobyte-0238688c-673e-4838-a16f-cdf6d30a2f43" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Acquiring lock "cinder-quobyte-c8ed1bc5-6f10-40b5-9bed-49b349497c62" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Lock "cinder-quobyte-c8ed1bc5-6f10-40b5-9bed-49b349497c62" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Deleting offline snapshot c8ed1bc5-6f10-40b5-9bed-49b349497c62 of volume 0238688c-673e-4838-a16f-cdf6d30a2f43 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] snapshot_file for this snap is: volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[65de5918-20db-4860-8690-faf452a86964]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:18 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 Feb 27 22:27:18 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:19 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.523s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc4485c-52ac-4be1-83e3-2c711201f019]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:19 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:27:19 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:19 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62" returned: 0 in 0.517s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0238688c-673e-4838-a16f-cdf6d30a2f43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[195149f6-c130-458e-b2fc-7f2f21c7adce]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:19 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 Feb 27 22:27:19 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:19 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.509s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.fd18c27d-c64e-43ec-875c-67d52905faedm3bwmy3s.img {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:19 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.fd18c27d-c64e-43ec-875c-67d52905faedm3bwmy3s.img Feb 27 22:27:19 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:19 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43" returned: 0 in 0.536s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:19 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 Feb 27 22:27:19 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:21 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62" returned: 0 in 1.557s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:21 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62 Feb 27 22:27:21 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.fd18c27d-c64e-43ec-875c-67d52905faedm3bwmy3s.img" returned: 0 in 2.169s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:21 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:21 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee31dc3-c942-49f1-866e-6fa75ad2eb4c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:21 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:27:21 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:21 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43.c8ed1bc5-6f10-40b5-9bed-49b349497c62" returned: 0 in 0.495s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Lock "cinder-quobyte-c8ed1bc5-6f10-40b5-9bed-49b349497c62" released by "_delete_snapshot" :: held 3.170s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Lock "cinder-quobyte-0238688c-673e-4838-a16f-cdf6d30a2f43" released by "delete_snapshot" :: held 3.190s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:22 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Created reservations ['7023cc21-c733-4d2f-8b5a-6b0bfb5100e5', '3880d802-594c-442c-aacd-64b9f9537796', 'bc3be8fa-3c21-473f-a0d4-ab58f19af79d', 'c1dc8bb4-c3b7-4db4-b451-e99a218f636a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:22 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Delete snapshot completed successfully. Feb 27 22:27:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-48c8d338-5822-43ad-be44-ba52f96e1719 tempest-CinderUnicodeTest-439798692 None] Lock "cinder-c8ed1bc5-6f10-40b5-9bed-49b349497c62-delete_snapshot" released by "delete_snapshot" :: held 3.315s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:22 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.611s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:22 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.fd18c27d-c64e-43ec-875c-67d52905faedm3bwmy3s.img {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:27:22 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Converted 1024.00 MB image at 471.74 MB/s Feb 27 22:27:22 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] fd18c27d-c64e-43ec-875c-67d52905faed was raw, no need to convert to raw {{(pid=83540) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 27 22:27:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Acquiring lock "cinder-0238688c-673e-4838-a16f-cdf6d30a2f43-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Lock "cinder-0238688c-673e-4838-a16f-cdf6d30a2f43-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Acquiring lock "cinder-quobyte-0238688c-673e-4838-a16f-cdf6d30a2f43" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Lock "cinder-quobyte-0238688c-673e-4838-a16f-cdf6d30a2f43" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:23 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0455dba4-c7f4-47e8-93fd-8fa08f6d2609]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:23 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 Feb 27 22:27:23 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:23 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43" returned: 0 in 0.531s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:23 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43 Feb 27 22:27:23 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:24 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0238688c-673e-4838-a16f-cdf6d30a2f43" returned: 0 in 0.413s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Lock "cinder-quobyte-0238688c-673e-4838-a16f-cdf6d30a2f43" released by "delete_volume" :: held 0.982s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Created reservations ['fd6f1df0-26fa-430c-8bd8-ebeecf06ef82', '527d6c6b-688f-44f0-a57a-e3d6fe508574', 'cdb6eb7e-8635-4227-b402-2a6f78c74560', '11f69c9c-d65e-4a34-a5f4-75bbed046ba2'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:24 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:24 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:24 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.409s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:24 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Deleted volume successfully. Feb 27 22:27:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-edb63624-22bb-4c62-ba1a-deb5520bdc5d tempest-CinderUnicodeTest-439798692 None] Lock "cinder-0238688c-673e-4838-a16f-cdf6d30a2f43-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Acquiring lock "cinder-2fd26934-99cb-4e7a-a7a8-64da78230f7c-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Lock "cinder-2fd26934-99cb-4e7a-a7a8-64da78230f7c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Acquiring lock "cinder-quobyte-2fd26934-99cb-4e7a-a7a8-64da78230f7c" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Lock "cinder-quobyte-2fd26934-99cb-4e7a-a7a8-64da78230f7c" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:25 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[40df1acc-ddb5-4cac-83f9-2d075c733d38]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:25 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c Feb 27 22:27:25 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:25 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c" returned: 0 in 0.565s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:25 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c Feb 27 22:27:25 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:26 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2fd26934-99cb-4e7a-a7a8-64da78230f7c" returned: 0 in 0.456s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Lock "cinder-quobyte-2fd26934-99cb-4e7a-a7a8-64da78230f7c" released by "delete_volume" :: held 1.046s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Created reservations ['178c511f-9185-402d-8016-62c1089dfb82', '6f7ef8c6-10b6-4b91-b333-6b1ec3b6680a', 'b6fae26f-296a-4143-8467-15422fe4d659', '1e3462eb-8063-44c8-b0e9-07d3af683188'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:26 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:26 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:26 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.407s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:26 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Deleted volume successfully. Feb 27 22:27:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2b5054e5-f78e-40d6-b6f0-dd632826c03d tempest-CinderUnicodeTest-439798692 None] Lock "cinder-2fd26934-99cb-4e7a-a7a8-64da78230f7c-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.573s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Uploaded volume to glance image-id: fd18c27d-c64e-43ec-875c-67d52905faed. {{(pid=83540) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1784}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.493s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2113503660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3180e14-7681-43f2-8973-f1c6a0c15d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:17Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Creating volume a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:27:32 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:32 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a 1073741824 Feb 27 22:27:32 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:32 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-92707e27-8689-47ac-a0c9-75a88f94009c tempest-VolumesActionsTest-408327979 None] Copy volume to image completed successfully. Feb 27 22:27:32 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a 1073741824" returned: 0 in 0.469s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=192,cinder:INSERT=63,cinder:UPDATE=203,cinder:DELETE=15 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:32 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a Feb 27 22:27:32 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:32 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a" returned: 0 in 0.444s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.068s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab1c149-4c90-441d-96bd-14b86d7a9688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc7f226-70b2-46ae-8c1f-6b0d34d2d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Creating offline snapshot a4cbcceb-8d3b-4e3d-8994-a2719286a50a of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3420264-9c23-4c75-b4fc-05f057a5ef3d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:33 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Volume volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a (a3180e14-7681-43f2-8973-f1c6a0c15d7a): created successfully Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc7f226-70b2-46ae-8c1f-6b0d34d2d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (6bd375d8-c281-41e9-bad1-4b51e98ea288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a78e7d2f-b33c-4877-971f-34b63adc6c52 tempest-VolumesGetTest-194305358 None] Created volume successfully. Feb 27 22:27:33 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:33 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:33 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.534s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:33 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a 1G Feb 27 22:27:33 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (5e40b519-e132-42af-8b5e-a6e7a6475baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028342d0-b905-435f-a3c3-a079f3437f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028342d0-b905-435f-a3c3-a079f3437f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-365687850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f04885e-d0a6-43ab-9ec1-9a1a4db40c99,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a3180e14-7681-43f2-8973-f1c6a0c15d7a,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:34Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e49b2d-ecf5-47a4-9804-28b89d204ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e49b2d-ecf5-47a4-9804-28b89d204ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d03632-8979-44b0-854b-7a1b913a9ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d03632-8979-44b0-854b-7a1b913a9ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7f04885e-d0a6-43ab-9ec1-9a1a4db40c99', 'volume_name': 'volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99', 'volume_size': 1, 'source_volid': 'a3180e14-7681-43f2-8973-f1c6a0c15d7a', 'source_volstatus': 'available'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506efef1-dd60-491a-b04d-09e7b7c1e2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506efef1-dd60-491a-b04d-09e7b7c1e2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47faa6d0-83e4-4c3b-9cca-a8f9b9f348ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:33 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Volume 7f04885e-d0a6-43ab-9ec1-9a1a4db40c99: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99', 'volume_size': 1, 'source_volid': 'a3180e14-7681-43f2-8973-f1c6a0c15d7a', 'source_volstatus': 'available'} Feb 27 22:27:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:34 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a 1G" returned: 0 in 0.495s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:34 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a Feb 27 22:27:34 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:34 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a" returned: 0 in 0.444s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:34 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a is being set with open permissions: ugo+rw Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:34 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a Feb 27 22:27:34 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:34 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a" returned: 0 in 0.416s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.731s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca336d78-ce9c-4f8d-999e-4255c99b86d7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:35 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:27:35 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:35 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-aa72d9ab-1191-484a-95ac-3510772e577c tempest-SnapshotsActionsTest-673607108 None] Create snapshot completed successfully Feb 27 22:27:35 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.503s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d99177-87b9-4804-8fa2-3c0198bfca4c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:35 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:27:35 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-a4cbcceb-8d3b-4e3d-8994-a2719286a50a-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-a4cbcceb-8d3b-4e3d-8994-a2719286a50a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-quobyte-a4cbcceb-8d3b-4e3d-8994-a2719286a50a" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-a4cbcceb-8d3b-4e3d-8994-a2719286a50a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Deleting offline snapshot a4cbcceb-8d3b-4e3d-8994-a2719286a50a of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] snapshot_file for this snap is: volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d367f5b-4442-4471-9328-36cc8178a075]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:35 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a Feb 27 22:27:35 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:35 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.503s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:36 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img Feb 27 22:27:36 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:36 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a" returned: 0 in 0.482s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:36 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadbd91c-9497-49c9-95e0-d2788bfed560]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:36 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:36 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:37 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 1.014s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:37 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a Feb 27 22:27:37 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:38 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img" returned: 0 in 2.069s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d6bdfc-f297-4e02-a2b6-cf9234a61901]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:38 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:27:38 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:38 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a" returned: 0 in 1.060s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:38 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a Feb 27 22:27:38 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:38 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.a4cbcceb-8d3b-4e3d-8994-a2719286a50a" returned: 0 in 0.410s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:38 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.631s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:27:38 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Converted 1024.00 MB image at 494.63 MB/s Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-a4cbcceb-8d3b-4e3d-8994-a2719286a50a" released by "_delete_snapshot" :: held 3.020s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" released by "delete_snapshot" :: held 3.038s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] 9dfbb2f2-9b63-4831-ab1e-57c00201e881 was raw, converting to qcow2 {{(pid=83540) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3e5930-cf8e-4294-b810-2ecb73ab74ad]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Created reservations ['6d599a86-2ae8-4602-8641-c77173b1a2ec', '7e82ee10-d509-43ca-b23d-3acfdc858c82', '57b90f70-563e-4ae6-915c-65fa661b5649', '43dab33a-756f-4ef9-a52f-cd8e20800720'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:38 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Delete snapshot completed successfully. Feb 27 22:27:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b75788e-cedd-4a80-8bd9-d1b3190631b4 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-a4cbcceb-8d3b-4e3d-8994-a2719286a50a-delete_snapshot" released by "delete_snapshot" :: held 3.153s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:38 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img Feb 27 22:27:38 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:39 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img" returned: 0 in 0.483s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:39 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img Feb 27 22:27:39 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:39 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img" returned: 1 in 0.463s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:27:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img /opt/stack/data/cinder/conversion/vol_upload_tgzz4f75 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:39 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img /opt/stack/data/cinder/conversion/vol_upload_tgzz4f75 Feb 27 22:27:39 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:40 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img /opt/stack/data/cinder/conversion/vol_upload_tgzz4f75" returned: 0 in 0.477s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Image conversion details: src /opt/stack/data/cinder/conversion/78c01ae5-0cd7-4639-8344-52587fcb16e2.temp_image.9dfbb2f2-9b63-4831-ab1e-57c00201e881ubun_5me.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_tgzz4f75 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:27:40 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff984b-cab9-4a85-a474-ab7913a37831]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tgzz4f75 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:40 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tgzz4f75 Feb 27 22:27:40 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:40 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tgzz4f75" returned: 0 in 0.467s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:40 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:40 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:41 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.506s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:27:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:27:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:27:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:27:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:27:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:27:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.619s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Uploaded volume to glance image-id: 9dfbb2f2-9b63-4831-ab1e-57c00201e881. {{(pid=83540) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1784}} Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.847s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:41 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Cloning volume a3180e14-7681-43f2-8973-f1c6a0c15d7a to volume 7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Creating offline snapshot 708add15-8dea-4149-9127-80bcd9de754d of volume a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:27:41 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2351da71-70b3-4836-b815-5eee4b2af730 tempest-VolumesActionsTest-408327979 None] Copy volume to image completed successfully. Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8329e9a-ae2a-432a-810a-6218c5c78689]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:41 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a Feb 27 22:27:41 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:42 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a" returned: 0 in 0.494s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:42 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d 1G Feb 27 22:27:42 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:42 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d 1G" returned: 0 in 0.521s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:42 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d Feb 27 22:27:42 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Acquiring lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Acquiring lock "cinder-quobyte-78c01ae5-0cd7-4639-8344-52587fcb16e2" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Lock "cinder-quobyte-78c01ae5-0cd7-4639-8344-52587fcb16e2" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a529c62-945e-4344-8624-70a638d94c90]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:43 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:27:43 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:43 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d" returned: 0 in 0.496s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:43 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d is being set with open permissions: ugo+rw Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:43 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d Feb 27 22:27:43 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:43 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.479s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:43 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2 Feb 27 22:27:43 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:43 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d" returned: 0 in 0.424s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:43 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.info Feb 27 22:27:43 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:43 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-78c01ae5-0cd7-4639-8344-52587fcb16e2" returned: 0 in 0.414s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Lock "cinder-quobyte-78c01ae5-0cd7-4639-8344-52587fcb16e2" released by "delete_volume" :: held 0.913s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Created reservations ['1ad2459f-b1fc-4a22-a99f-aa03b25dbbce', '6369c163-7455-4be6-a205-7cb3bcab01c6', 'e87fef21-6fa2-43ce-a5fb-999621588b8c', 'cc0774cb-ae99-4b81-8179-14633e4a5982'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:43 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:43 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:44 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.info" returned: 0 in 0.429s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:44 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.info is being set with open permissions: ugo+rw Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:44 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.info Feb 27 22:27:44 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:44 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.452s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Deleted volume successfully. Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-96f9d402-dea5-478b-86d1-7544d4c6fd5e tempest-VolumesActionsTest-408327979 None] Lock "cinder-78c01ae5-0cd7-4639-8344-52587fcb16e2-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:44 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.info" returned: 0 in 0.471s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] snapshot: 708add15-8dea-4149-9127-80bcd9de754d, volume: 7f04885e-d0a6-43ab-9ec1-9a1a4db40c99, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[052ab6c4-7148-43a7-9119-1a4c98f087a7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:44 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d Feb 27 22:27:44 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:45 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf53907-0478-4fe1-b58a-a39f8bf2e2df]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:45 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a Feb 27 22:27:45 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:45 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a" returned: 0 in 0.536s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:27:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:45 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 Feb 27 22:27:45 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:47 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" returned: 0 in 2.207s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:47 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a1d6df-e9ae-4259-866e-367007aee9e3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:47 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a Feb 27 22:27:47 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:48 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a" returned: 0 in 0.739s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:48 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:27:48 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Converted 1024.00 MB image at 463.71 MB/s Feb 27 22:27:48 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 is being set with open permissions: ugo+rw Feb 27 22:27:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:48 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 Feb 27 22:27:48 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:49 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" returned: 0 in 0.455s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" released by "_copy_volume_from_snapshot" :: held 4.515s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-708add15-8dea-4149-9127-80bcd9de754d" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-708add15-8dea-4149-9127-80bcd9de754d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Deleting offline snapshot 708add15-8dea-4149-9127-80bcd9de754d of volume a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] snapshot_file for this snap is: volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[633135b6-2de2-4ad0-a376-87125e77f6c3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:49 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d Feb 27 22:27:49 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Flow 'volume_create_manager' (f76852eb-7e5c-4e5b-ad40-4990c5e5aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8dee51-3d78-44ca-966c-a88ae0384741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8dee51-3d78-44ca-966c-a88ae0384741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-607572402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390ee308-ee51-4a2c-a93b-a3cd05f91450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93def9f57eba4c17a4b192a868bf6f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:49Z,use_quota=True,user_id='2d2acdddd18f487da7a6dde869b5d9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b80b043-84f3-45ea-8192-bc2b13c5e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b80b043-84f3-45ea-8192-bc2b13c5e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6735039-1ec2-4db8-80e2-a79112d4ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6735039-1ec2-4db8-80e2-a79112d4ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390ee308-ee51-4a2c-a93b-a3cd05f91450', 'volume_name': 'volume-390ee308-ee51-4a2c-a93b-a3cd05f91450', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efe340d-794a-49a9-b3a1-7a1a70f32e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efe340d-794a-49a9-b3a1-7a1a70f32e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a405a8-5a68-4790-9140-b5f9af1f11d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:49 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Volume 390ee308-ee51-4a2c-a93b-a3cd05f91450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390ee308-ee51-4a2c-a93b-a3cd05f91450', 'volume_size': 1} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:49 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d" returned: 0 in 0.509s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c131934-f896-40d4-8a79-26f6bcb4c791]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:49 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a Feb 27 22:27:49 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:50 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a" returned: 0 in 0.483s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:50 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d Feb 27 22:27:50 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:50 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:50 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d Feb 27 22:27:50 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:50 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a.708add15-8dea-4149-9127-80bcd9de754d" returned: 0 in 0.408s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-708add15-8dea-4149-9127-80bcd9de754d" released by "_delete_snapshot" :: held 1.896s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.370s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.893s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47faa6d0-83e4-4c3b-9cca-a8f9b9f348ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99', 'volume_size': 1, 'source_volid': 'a3180e14-7681-43f2-8973-f1c6a0c15d7a', 'source_volstatus': 'available'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918b075a-af87-40e3-a674-20505f180acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:50 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Volume volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 (7f04885e-d0a6-43ab-9ec1-9a1a4db40c99): created successfully Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918b075a-af87-40e3-a674-20505f180acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (5e40b519-e132-42af-8b5e-a6e7a6475baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Creating offline snapshot 751eea1f-16bf-4897-9f81-56a25214f878 of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:27:51 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce29212-50fd-444c-a954-f29bf5c523af]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:51 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2e632c08-525e-44c7-b42d-e3f9a59871d3 tempest-VolumesGetTest-194305358 None] Created volume successfully. Feb 27 22:27:51 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:51 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:51 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.472s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:51 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 1G Feb 27 22:27:51 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:51 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 1G" returned: 0 in 0.476s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:51 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 Feb 27 22:27:51 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (b56554a3-b489-4eac-9bd3-852edeeadb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80985da-45f0-465d-9145-a62c46ebecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80985da-45f0-465d-9145-a62c46ebecb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1611618555',display_name='tempest-VolumesGetTest-Volume-1630664014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de5c093-1397-4846-b922-c62f12af2c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:52Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0ec52f-1ce6-45aa-b02f-32832252a23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0ec52f-1ce6-45aa-b02f-32832252a23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:52 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f6e402-5c46-44c0-a7c9-3eecccbc95a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f6e402-5c46-44c0-a7c9-3eecccbc95a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de5c093-1397-4846-b922-c62f12af2c2e', 'volume_name': 'volume-6de5c093-1397-4846-b922-c62f12af2c2e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6069a86c-368c-44db-a963-0beeeb915cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6069a86c-368c-44db-a963-0beeeb915cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84072d76-da73-4960-9dde-fd04d3319301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:52 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Volume 6de5c093-1397-4846-b922-c62f12af2c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de5c093-1397-4846-b922-c62f12af2c2e', 'volume_size': 1} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878" returned: 0 in 0.520s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:52 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 is being set with open permissions: ugo+rw Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:52 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 Feb 27 22:27:52 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:52 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878" returned: 0 in 0.404s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.360s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-607572402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390ee308-ee51-4a2c-a93b-a3cd05f91450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93def9f57eba4c17a4b192a868bf6f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:49Z,use_quota=True,user_id='2d2acdddd18f487da7a6dde869b5d9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Creating volume 390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:27:52 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:27:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:52 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 1073741824 Feb 27 22:27:52 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:52 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d7e1bb14-cd76-4003-91ca-cfd8afdb2dfa tempest-SnapshotsActionsTest-673607108 None] Create snapshot completed successfully Feb 27 22:27:53 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 1073741824" returned: 0 in 0.472s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:53 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 Feb 27 22:27:53 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-751eea1f-16bf-4897-9f81-56a25214f878-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-751eea1f-16bf-4897-9f81-56a25214f878-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Acquiring lock "cinder-quobyte-751eea1f-16bf-4897-9f81-56a25214f878" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-751eea1f-16bf-4897-9f81-56a25214f878" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Deleting offline snapshot 751eea1f-16bf-4897-9f81-56a25214f878 of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] snapshot_file for this snap is: volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2b17ca-6506-4840-8940-15d602bd5d32]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:53 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 Feb 27 22:27:53 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:53 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450" returned: 0 in 0.437s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1611618555',display_name='tempest-VolumesGetTest-Volume-1630664014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de5c093-1397-4846-b922-c62f12af2c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:52Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Creating volume 6de5c093-1397-4846-b922-c62f12af2c2e {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:27:53 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a405a8-5a68-4790-9140-b5f9af1f11d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390ee308-ee51-4a2c-a93b-a3cd05f91450', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:53 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e 1073741824 Feb 27 22:27:53 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10eb4019-b80a-43ac-b47d-367b4659b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:53 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Volume volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 (390ee308-ee51-4a2c-a93b-a3cd05f91450): created successfully Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10eb4019-b80a-43ac-b47d-367b4659b998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:53 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Flow 'volume_create_manager' (f76852eb-7e5c-4e5b-ad40-4990c5e5aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:53 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-93ab6d65-d3ec-4ae7-b832-b6798317b11a tempest-VolumesCloneTest-2004996478 None] Created volume successfully. Feb 27 22:27:54 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878" returned: 0 in 0.487s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d833369e-279f-4088-8488-42e8a033f818]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:54 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:54 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:54 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e 1073741824" returned: 0 in 0.478s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:54 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e Feb 27 22:27:54 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:54 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.487s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:54 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 Feb 27 22:27:54 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:54 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e" returned: 0 in 0.451s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84072d76-da73-4960-9dde-fd04d3319301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de5c093-1397-4846-b922-c62f12af2c2e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79289879-38ce-4bea-9dbb-89d2a560e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:54 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Volume volume-6de5c093-1397-4846-b922-c62f12af2c2e (6de5c093-1397-4846-b922-c62f12af2c2e): created successfully Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79289879-38ce-4bea-9dbb-89d2a560e584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (b56554a3-b489-4eac-9bd3-852edeeadb84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:54 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f9b55f3f-5f6f-46b8-86b9-b2c7a712f3b0 tempest-VolumesGetTest-194305358 None] Created volume successfully. Feb 27 22:27:54 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Flow 'volume_create_manager' (930bfd7e-2548-452e-998e-7e3cbbf61af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb94808c-063b-4455-ac70-9a1e02a57708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb94808c-063b-4455-ac70-9a1e02a57708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1948686142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f3f99ad-7ce1-4fb5-b2cc-ff884738b476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93def9f57eba4c17a4b192a868bf6f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:27:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=390ee308-ee51-4a2c-a93b-a3cd05f91450,status='creating',terminated_at=None,updated_at=2026-02-27T21:27:55Z,use_quota=True,user_id='2d2acdddd18f487da7a6dde869b5d9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cd5b9b-4ee4-4d18-9cd2-a09c204d96db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cd5b9b-4ee4-4d18-9cd2-a09c204d96db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e78d66-9fa6-4147-aa0b-d549c3b2bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e78d66-9fa6-4147-aa0b-d549c3b2bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4f3f99ad-7ce1-4fb5-b2cc-ff884738b476', 'volume_name': 'volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476', 'volume_size': 2, 'source_volid': '390ee308-ee51-4a2c-a93b-a3cd05f91450', 'source_volstatus': 'available'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09181f75-192b-4a6e-9700-03d3aa9573d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09181f75-192b-4a6e-9700-03d3aa9573d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a25511e-3e38-4230-a3ea-ec8f7cf9f3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:27:55 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Volume 4f3f99ad-7ce1-4fb5-b2cc-ff884738b476: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476', 'volume_size': 2, 'source_volid': '390ee308-ee51-4a2c-a93b-a3cd05f91450', 'source_volstatus': 'available'} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:55 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Cloning volume 390ee308-ee51-4a2c-a93b-a3cd05f91450 to volume 4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Creating offline snapshot 04ba5d40-9abc-4309-b555-348a50d31649 of volume 390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[668aec32-93e6-49e3-b761-c5114f9ce328]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:55 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 Feb 27 22:27:55 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:55 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878" returned: 0 in 0.530s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:55 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878 Feb 27 22:27:55 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:55 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-6de5c093-1397-4846-b922-c62f12af2c2e-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450" returned: 0 in 0.532s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Lock "cinder-6de5c093-1397-4846-b922-c62f12af2c2e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:55 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 1G Feb 27 22:27:55 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:55 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.751eea1f-16bf-4897-9f81-56a25214f878" returned: 0 in 0.481s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-6de5c093-1397-4846-b922-c62f12af2c2e" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-751eea1f-16bf-4897-9f81-56a25214f878" released by "_delete_snapshot" :: held 2.058s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" released by "delete_snapshot" :: held 2.072s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-6de5c093-1397-4846-b922-c62f12af2c2e" acquired by "delete_volume" :: waited 0.021s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2480b430-d575-4760-8135-1f9b30e3bb74]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Created reservations ['adb4a629-2485-4ec3-a11e-d0dd9812d4d5', '0601cf2f-c84d-442f-8b1c-b7f01408d3c0', 'b22f797f-2dd1-4145-a23c-faaa0ca78995', '5d3b7b79-ff9c-436f-900c-83c3c7653eee'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:55 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Delete snapshot completed successfully. Feb 27 22:27:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c1946337-de08-4e66-88c6-3ab7b00f1d82 tempest-SnapshotsActionsTest-487874462 None] Lock "cinder-751eea1f-16bf-4897-9f81-56a25214f878-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:55 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e Feb 27 22:27:55 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:56 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 1G" returned: 0 in 0.506s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:56 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 Feb 27 22:27:56 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:56 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:56 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e Feb 27 22:27:56 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:56 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649" returned: 0 in 0.417s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:56 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 is being set with open permissions: ugo+rw Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:56 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 Feb 27 22:27:56 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:56 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6de5c093-1397-4846-b922-c62f12af2c2e" returned: 0 in 0.390s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-6de5c093-1397-4846-b922-c62f12af2c2e" released by "delete_volume" :: held 0.938s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Created reservations ['c38487f7-06bd-48f2-8342-67279b47466c', '5dcaf9e4-7cd0-4854-a2b7-3ec143a2284c', '7c363438-652c-4ac3-bca2-082d3cdff2ce', '7b8e46bb-92ca-4542-ad83-ffee287ff6ed'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:56 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:56 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:57 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649" returned: 0 in 0.459s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:57 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.info Feb 27 22:27:57 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "cinder-40218355-04b6-4cb3-b715-e518c6cf7a3c-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-40218355-04b6-4cb3-b715-e518c6cf7a3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "cinder-quobyte-40218355-04b6-4cb3-b715-e518c6cf7a3c" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-quobyte-40218355-04b6-4cb3-b715-e518c6cf7a3c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Deleting offline snapshot 40218355-04b6-4cb3-b715-e518c6cf7a3c of volume 10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] snapshot_file for this snap is: volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d999cd-abcf-47a9-a89e-ed2604a07099]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:57 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.449s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:57 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Deleted volume successfully. Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1bc39f2c-944a-48b1-bb87-b5a570b57eec tempest-VolumesGetTest-194305358 None] Lock "cinder-6de5c093-1397-4846-b922-c62f12af2c2e-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:57 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:57 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:57 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.info" returned: 0 in 0.428s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:57 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.info is being set with open permissions: ugo+rw Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:57 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.info Feb 27 22:27:57 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:57 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.509s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3a180b-8172-41be-9774-3a0761aef052]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:57 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc Feb 27 22:27:57 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Lock "cinder-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:57 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.info" returned: 0 in 0.414s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "cinder-quobyte-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-quobyte-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] snapshot: 04ba5d40-9abc-4309-b555-348a50d31649, volume: 4f3f99ad-7ce1-4fb5-b2cc-ff884738b476, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" acquired by "delete_volume" :: waited 0.034s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[881242dd-eed1-44f4-9a84-d0777e6d0b4a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca960d9-18be-4e81-8e42-656e6090a2e2]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:58 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 Feb 27 22:27:58 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:58 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 Feb 27 22:27:58 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:58 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc" returned: 0 in 0.527s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:58 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:58 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:58 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" returned: 0 in 0.498s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:58 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649" returned: 0 in 0.521s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-390ee308-ee51-4a2c-a93b-a3cd05f91450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:27:58 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99 Feb 27 22:27:58 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd53cbca-3c63-42b5-b89a-e1f0e31aca51]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:58 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 Feb 27 22:27:58 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:58 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.453s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:58 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c Feb 27 22:27:58 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:58 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" returned: 0 in 0.426s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99" released by "delete_volume" :: held 0.954s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Created reservations ['5f131f76-419c-4805-983b-fc30eb13a42c', 'ba78172e-c9ec-481b-82d0-56982a6aa71d', '9845534d-695b-4277-9bc6-9e1264227aea', '96575d79-7b61-4d71-8a25-db976dec461a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:59 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450" returned: 0 in 0.495s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:59 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 Feb 27 22:27:59 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:27:59 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:27:59 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:27:59 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc.40218355-04b6-4cb3-b715-e518c6cf7a3c" returned: 0 in 0.462s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-quobyte-40218355-04b6-4cb3-b715-e518c6cf7a3c" released by "_delete_snapshot" :: held 2.024s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" released by "delete_snapshot" :: held 2.037s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Created reservations ['cdbc1c2d-3719-488c-971d-dc0741c2d4f1', '9104e0b6-cc34-4e93-89db-bd58b23a0933', '0b6f52a0-f40a-46ab-bff4-ade3f431ebfc', 'e5d8f69a-873a-46a4-aac8-4f48df9876cd'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:27:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Delete snapshot completed successfully. Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5ca0ca6e-b62b-4acb-ab76-d275ba71e589 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-40218355-04b6-4cb3-b715-e518c6cf7a3c-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:27:59 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.491s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:27:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Deleted volume successfully. Feb 27 22:27:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9e3270de-c85a-4c75-9932-fa30b035ad94 tempest-VolumesGetTest-194305358 None] Lock "cinder-7f04885e-d0a6-43ab-9ec1-9a1a4db40c99-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-a3180e14-7681-43f2-8973-f1c6a0c15d7a-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Lock "cinder-a3180e14-7681-43f2-8973-f1c6a0c15d7a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-a3180e14-7681-43f2-8973-f1c6a0c15d7a" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-a3180e14-7681-43f2-8973-f1c6a0c15d7a" acquired by "delete_volume" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8be0e7e-234b-4c41-b979-0983a32cad33]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "cinder-10d8e96d-9b29-48dd-84a4-9d646c2626bc-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-10d8e96d-9b29-48dd-84a4-9d646c2626bc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:00 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a Feb 27 22:28:00 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" acquired by "delete_volume" :: waited 0.026s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9631977a-64cb-405a-ad7e-cafe9438fc02]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:01 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc Feb 27 22:28:01 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:01 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" returned: 0 in 2.280s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[50709148-5991-46fe-9f66-946eb4b60f72]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:01 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 Feb 27 22:28:01 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:01 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a" returned: 0 in 1.053s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:01 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a Feb 27 22:28:01 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:01 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc" returned: 0 in 0.856s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:01 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc Feb 27 22:28:01 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:01 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a3180e14-7681-43f2-8973-f1c6a0c15d7a" returned: 0 in 0.415s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-a3180e14-7681-43f2-8973-f1c6a0c15d7a" released by "delete_volume" :: held 1.539s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Created reservations ['929f3499-adb7-45ab-9b3b-78057ef59878', '51ff1436-c891-421b-97c5-d18e6a87a25e', 'c6719941-4a97-45db-9527-7ad22e6144cf', 'f1bfc214-dd8b-4eb6-a197-e457701d6bea'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:01 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450" returned: 0 in 0.667s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:28:01 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Converted 1024.00 MB image at 448.90 MB/s Feb 27 22:28:01 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 is being set with open permissions: ugo+rw Feb 27 22:28:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:01 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:01 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:02 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 Feb 27 22:28:02 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:02 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-10d8e96d-9b29-48dd-84a4-9d646c2626bc" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-quobyte-10d8e96d-9b29-48dd-84a4-9d646c2626bc" released by "delete_volume" :: held 1.365s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Created reservations ['d175ee87-0b5b-4278-ae0f-af0dd32134a0', '457c465e-4466-4868-8848-813abdd58e5b', '229de57c-3134-45b7-8c03-e92109755e28', '35d64683-96da-480f-88d5-1ec3f1e0bedc'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:02 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:02 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:02 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" returned: 0 in 0.407s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-quobyte-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" released by "_copy_volume_from_snapshot" :: held 4.443s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "cinder-quobyte-04ba5d40-9abc-4309-b555-348a50d31649" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-quobyte-04ba5d40-9abc-4309-b555-348a50d31649" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Deleting offline snapshot 04ba5d40-9abc-4309-b555-348a50d31649 of volume 390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] snapshot_file for this snap is: volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef4b06a-c90b-4554-b15d-07c54742a480]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:02 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.500s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:02 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Deleted volume successfully. Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e36482a-e994-4014-895f-bfc59da63d9c tempest-VolumesGetTest-194305358 None] Lock "cinder-a3180e14-7681-43f2-8973-f1c6a0c15d7a-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:02 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 Feb 27 22:28:02 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:02 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:02 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Deleted volume successfully. Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-704765a3-b5a3-48c1-9963-4f88d82ba593 tempest-SnapshotsActionsTest-673607108 None] Lock "cinder-10d8e96d-9b29-48dd-84a4-9d646c2626bc-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=168,cinder:SELECT=134,cinder:INSERT=35,cinder:DELETE=13 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (99cf791d-91ea-4888-9c03-40a97723c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e314fa6c-4e3d-42f8-88fc-ecd0868e270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e314fa6c-4e3d-42f8-88fc-ecd0868e270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1612223379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dffee1-a11d-4551-b7f5-6d4e5da49a8e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:03Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b0097a-4cfb-4374-a92a-0e30ee7e4ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b0097a-4cfb-4374-a92a-0e30ee7e4ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b79775-63ad-46b4-a01a-8b9442d0b8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.image.glance [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Creating Keystone auth plugin from conf {{(pid=83540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 22:28:03 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649" returned: 0 in 0.615s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-390ee308-ee51-4a2c-a93b-a3cd05f91450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[effb7b2a-d11d-4be1-9824-6affb25d13c9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:03 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 Feb 27 22:28:03 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b79775-63ad-46b4-a01a-8b9442d0b8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4dffee1-a11d-4551-b7f5-6d4e5da49a8e', 'volume_name': 'volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a67549-fab3-42d6-acea-c1171a2bf08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a67549-fab3-42d6-acea-c1171a2bf08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f9de00-ea12-4a60-b9d5-ca989e76b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:03 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Volume e4dffee1-a11d-4551-b7f5-6d4e5da49a8e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Trying to clone e4dffee1-a11d-4551-b7f5-6d4e5da49a8e from image b38627d9-9522-4831-a36d-1e8d5b5fd424 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]). {{(pid=83540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 22:28:03 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Image download 20.69 MB at 20.69 MB/s Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a2d2a8-33ab-4aee-8664-006331e67719]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:03 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD Feb 27 22:28:03 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:03 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450" returned: 0 in 0.624s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:03 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 Feb 27 22:28:03 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:04 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD" returned: 0 in 0.570s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Temporary image b38627d9-9522-4831-a36d-1e8d5b5fd424 is fetched for user 2285a943ffae411ebdbbc02976de3f3d. {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb09db-83fb-4651-bea0-7f1fa750613e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:04 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649" returned: 0 in 0.591s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:04 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD Feb 27 22:28:04 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:04 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649 Feb 27 22:28:04 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:04 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD" returned: 0 in 0.551s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:04 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450.04ba5d40-9abc-4309-b555-348a50d31649" returned: 0 in 0.512s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-quobyte-04ba5d40-9abc-4309-b555-348a50d31649" released by "_delete_snapshot" :: held 2.405s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.767s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.079s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1612223379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dffee1-a11d-4551-b7f5-6d4e5da49a8e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:03Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Creating volume e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:04 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a25511e-3e38-4230-a3ea-ec8f7cf9f3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476', 'volume_size': 2, 'source_volid': '390ee308-ee51-4a2c-a93b-a3cd05f91450', 'source_volstatus': 'available'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bc5962-d856-4a35-bf14-e27e8f2bd3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:04 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e 1073741824 Feb 27 22:28:04 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:04 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Volume volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 (4f3f99ad-7ce1-4fb5-b2cc-ff884738b476): created successfully Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bc5962-d856-4a35-bf14-e27e8f2bd3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Flow 'volume_create_manager' (930bfd7e-2548-452e-998e-7e3cbbf61af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b134acbf-80af-43e0-a720-96492a7206c5 tempest-VolumesCloneTest-2004996478 None] Created volume successfully. Feb 27 22:28:05 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e 1073741824" returned: 0 in 0.555s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:05 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e Feb 27 22:28:05 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "cinder-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:05 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" returned: 0 in 0.476s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "cinder-quobyte-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-quobyte-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" acquired by "delete_volume" :: waited 0.017s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Attempting download of b38627d9-9522-4831-a36d-1e8d5b5fd424 ((None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}])) to volume e4dffee1-a11d-4551-b7f5-6d4e5da49a8e. {{(pid=83540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0075d167-c340-49b9-9983-4b13978e87f1]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:05 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fdb7f9-1901-4fa4-9812-c80dd6876ed8]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_2ylpn049 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:06 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 Feb 27 22:28:06 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:06 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_2ylpn049 Feb 27 22:28:06 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:06 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_2ylpn049" returned: 0 in 0.501s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_2ylpn049 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:06 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" returned: 0 in 0.553s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:06 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476 Feb 27 22:28:06 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:06 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_2ylpn049 Feb 27 22:28:06 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:07 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" returned: 0 in 0.485s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-quobyte-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476" released by "delete_volume" :: held 1.064s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Created reservations ['0677b5e8-db80-46d3-b434-1071620a96fb', '44965f02-ff1c-4367-b5aa-312aca2faa6b', 'c79e5a89-6aa6-40c3-8ee9-c29084d9e4f3', '47ed0042-d32e-4a3e-bb71-5e4582bd0789'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:07 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_2ylpn049" returned: 1 in 0.620s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_2ylpn049' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[40643091-b465-494a-9a50-c3839cd1e42a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:07 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:07 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:07 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD Feb 27 22:28:07 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:07 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.493s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:07 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Deleted volume successfully. Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5669ab2c-d24e-43b0-ab69-01028a58f370 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-4f3f99ad-7ce1-4fb5-b2cc-ff884738b476-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:07 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD" returned: 0 in 0.553s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] b38627d9-9522-4831-a36d-1e8d5b5fd424 was qcow2, converting to raw {{(pid=83540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 22:28:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:07 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e Feb 27 22:28:07 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "cinder-390ee308-ee51-4a2c-a93b-a3cd05f91450-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-390ee308-ee51-4a2c-a93b-a3cd05f91450-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "cinder-quobyte-390ee308-ee51-4a2c-a93b-a3cd05f91450" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-quobyte-390ee308-ee51-4a2c-a93b-a3cd05f91450" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ff88a-17c1-4ba5-9206-ef8e195396ff]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:08 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 Feb 27 22:28:08 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:08 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" returned: 0 in 1.060s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_i0lhf7q2devstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:28:08 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Converted 112.00 MB image at 105.46 MB/s Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:08 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e 1G Feb 27 22:28:08 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:08 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450" returned: 0 in 0.681s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:08 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450 Feb 27 22:28:08 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:09 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e 1G" returned: 0 in 0.494s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c5bc41-4c0e-46e0-b1ee-71b5812c1fb1]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:09 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-390ee308-ee51-4a2c-a93b-a3cd05f91450" returned: 0 in 0.514s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-quobyte-390ee308-ee51-4a2c-a93b-a3cd05f91450" released by "delete_volume" :: held 1.239s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:09 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e Feb 27 22:28:09 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Created reservations ['ba094822-d0ab-461d-87d8-f587a5a6c445', 'ed64ad2a-ea1f-402a-878d-2223da290d62', '29a125ea-2cba-4cdd-a4c7-1961bd4ad3a3', '15a095dd-8d4f-43c5-9f07-9f9c0308a9aa'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:09 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:09 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:09 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" returned: 0 in 0.538s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:09 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e Feb 27 22:28:09 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:09 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.499s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:09 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Deleted volume successfully. Feb 27 22:28:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-006b25df-8b01-4774-a290-ba61f2c951f3 tempest-VolumesCloneTest-2004996478 None] Lock "cinder-390ee308-ee51-4a2c-a93b-a3cd05f91450-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:10 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" returned: 1 in 0.574s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Downloaded image b38627d9-9522-4831-a36d-1e8d5b5fd424 ((None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}])) to volume e4dffee1-a11d-4551-b7f5-6d4e5da49a8e successfully. {{(pid=83540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Temporary image b38627d9-9522-4831-a36d-1e8d5b5fd424 for user 2285a943ffae411ebdbbc02976de3f3d is deleted. {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Marking volume e4dffee1-a11d-4551-b7f5-6d4e5da49a8e as bootable. {{(pid=83540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Copying metadata from image b38627d9-9522-4831-a36d-1e8d5b5fd424 to e4dffee1-a11d-4551-b7f5-6d4e5da49a8e. {{(pid=83540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Creating volume glance metadata for volume e4dffee1-a11d-4551-b7f5-6d4e5da49a8e backed by image b38627d9-9522-4831-a36d-1e8d5b5fd424 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f9de00-ea12-4a60-b9d5-ca989e76b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab353c4-422d-4839-bb98-ffb6276480bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:10 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Volume volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e (e4dffee1-a11d-4551-b7f5-6d4e5da49a8e): created successfully Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab353c4-422d-4839-bb98-ffb6276480bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (99cf791d-91ea-4888-9c03-40a97723c964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:10 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-552c37dd-852c-4c1f-ba14-108d3b7fc5a3 tempest-VolumesGetTest-194305358 None] Created volume successfully. Feb 27 22:28:11 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (26bf374c-2312-4a2e-af78-aa26ece20313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bece72-adc0-4543-9816-0afb22b62da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bece72-adc0-4543-9816-0afb22b62da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-776033433',display_name='tempest-VolumesGetTest-Volume-939895189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024d8c34-8cb9-4546-b641-7cdd4c3043e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:12Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eea97c5-90fd-4007-b527-c62967b871be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eea97c5-90fd-4007-b527-c62967b871be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5831b75f-004a-4f6d-b5c2-50392c571275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5831b75f-004a-4f6d-b5c2-50392c571275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024d8c34-8cb9-4546-b641-7cdd4c3043e5', 'volume_name': 'volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9c0658-57bc-422d-be8c-a4c0e9fd3119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9c0658-57bc-422d-be8c-a4c0e9fd3119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24432588-a86b-4995-bd58-147c5162ad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Volume 024d8c34-8cb9-4546-b641-7cdd4c3043e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5', 'volume_size': 1} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-776033433',display_name='tempest-VolumesGetTest-Volume-939895189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024d8c34-8cb9-4546-b641-7cdd4c3043e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38a14cf4851453ab8aa27fd8b85bdcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:12Z,use_quota=True,user_id='2285a943ffae411ebdbbc02976de3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Creating volume 024d8c34-8cb9-4546-b641-7cdd4c3043e5 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:12 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:12 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 1073741824 Feb 27 22:28:12 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Flow 'volume_create_manager' (6b10f8e1-b0fd-4163-9856-6c0534a8a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdc7f08-5f22-4b02-b985-15866ab7f77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdc7f08-5f22-4b02-b985-15866ab7f77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2117763086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6163aa5-a641-4cb9-9bb1-bd427dc169a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b110e0b4f484699004dd464b29bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:13Z,use_quota=True,user_id='c82069541b0a4a23af3328b4f225cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10094346-9663-41f1-8ca8-c8e6b2dcdd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10094346-9663-41f1-8ca8-c8e6b2dcdd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c9da99-abc7-47ce-b724-4226c640f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.image.glance [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Creating Keystone auth plugin from conf {{(pid=83540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 22:28:12 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 1073741824" returned: 0 in 0.587s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:12 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 Feb 27 22:28:12 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c9da99-abc7-47ce-b724-4226c640f851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6163aa5-a641-4cb9-9bb1-bd427dc169a1', 'volume_name': 'volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c084e2b7-9072-43a9-9295-41ecab367c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c084e2b7-9072-43a9-9295-41ecab367c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51567cf-c19f-48ac-9991-8e64b0e52d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:12 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Volume f6163aa5-a641-4cb9-9bb1-bd427dc169a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 22:28:12 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Trying to clone f6163aa5-a641-4cb9-9bb1-bd427dc169a1 from image b38627d9-9522-4831-a36d-1e8d5b5fd424 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]). {{(pid=83540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 22:28:13 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Image download 20.69 MB at 20.69 MB/s Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd59931-a6e0-43fd-8624-5110d900ecb3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:13 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5" returned: 0 in 0.549s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24432588-a86b-4995-bd58-147c5162ad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94df2e8-23c1-4c28-b9fe-f46f7187b259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:13 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Volume volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 (024d8c34-8cb9-4546-b641-7cdd4c3043e5): created successfully Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94df2e8-23c1-4c28-b9fe-f46f7187b259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Flow 'volume_create_manager' (26bf374c-2312-4a2e-af78-aa26ece20313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:13 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-62991380-5896-4124-b356-56c378b7f2f4 tempest-VolumesGetTest-194305358 None] Created volume successfully. Feb 27 22:28:13 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD Feb 27 22:28:13 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:13 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD" returned: 0 in 0.615s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Temporary image b38627d9-9522-4831-a36d-1e8d5b5fd424 is fetched for user c82069541b0a4a23af3328b4f225cdc3. {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b79a655-80a4-4f06-8908-52cea0d383ac]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:13 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD Feb 27 22:28:13 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-024d8c34-8cb9-4546-b641-7cdd4c3043e5-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Lock "cinder-024d8c34-8cb9-4546-b641-7cdd4c3043e5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-024d8c34-8cb9-4546-b641-7cdd4c3043e5" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-024d8c34-8cb9-4546-b641-7cdd4c3043e5" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf8d5e-52c3-4b5c-9ea4-266e84111af9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:14 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 Feb 27 22:28:14 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:14 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD" returned: 0 in 0.572s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2117763086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6163aa5-a641-4cb9-9bb1-bd427dc169a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b110e0b4f484699004dd464b29bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:13Z,use_quota=True,user_id='c82069541b0a4a23af3328b4f225cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Creating volume f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:14 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:14 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 1073741824 Feb 27 22:28:14 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:14 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5" returned: 0 in 0.586s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:14 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5 Feb 27 22:28:14 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:15 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 1073741824" returned: 0 in 0.538s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:15 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:15 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:15 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-024d8c34-8cb9-4546-b641-7cdd4c3043e5" returned: 0 in 0.531s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-024d8c34-8cb9-4546-b641-7cdd4c3043e5" released by "delete_volume" :: held 1.144s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Created reservations ['a29d56a2-8312-45d7-8ecb-9930515fe54f', 'c7b4c135-4fbb-4d6f-a967-845ea3e8d8c8', 'fceaf392-cba4-4c4c-8c02-78ce129f6b1a', '8237b327-0706-45cb-9ca5-434bd156c910'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:15 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 0 in 0.530s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:15 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:15 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Attempting download of b38627d9-9522-4831-a36d-1e8d5b5fd424 ((None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}])) to volume f6163aa5-a641-4cb9-9bb1-bd427dc169a1. {{(pid=83540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f7d95-755d-46b4-ac52-ed0c52e2c6ae]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_4y5ft01f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:15 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_4y5ft01f Feb 27 22:28:15 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:16 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.494s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:16 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Deleted volume successfully. Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f731a13b-bf03-4ee1-aa36-de8040ead17d tempest-VolumesGetTest-194305358 None] Lock "cinder-024d8c34-8cb9-4546-b641-7cdd4c3043e5-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:16 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_4y5ft01f" returned: 0 in 0.571s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_4y5ft01f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:16 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_4y5ft01f Feb 27 22:28:16 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Lock "cinder-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Acquiring lock "cinder-quobyte-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48540205-8b20-4fae-983e-e9f1d6bf6c59]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:16 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e Feb 27 22:28:16 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:16 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_4y5ft01f" returned: 1 in 0.565s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_4y5ft01f' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f366dddf-90df-4521-b97a-59c2e73b1a3a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:16 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD Feb 27 22:28:16 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:17 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" returned: 0 in 0.584s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:17 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e Feb 27 22:28:17 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:17 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD" returned: 0 in 0.522s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] b38627d9-9522-4831-a36d-1e8d5b5fd424 was qcow2, converting to raw {{(pid=83540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:17 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:17 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Flow 'volume_create_manager' (cf984257-bec3-479b-81e2-b38b8123cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1405b1e-7b0d-497b-b12f-9e103e83f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1405b1e-7b0d-497b-b12f-9e103e83f26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-279801132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a71a6b5-8b52-4474-8527-5167e9d3c3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6056a8464040dea583578c0de18e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:17Z,use_quota=True,user_id='35db62230d96457f89b351c0227fe098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c99150f-2872-4bfe-bcb5-8e02d6b3a128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c99150f-2872-4bfe-bcb5-8e02d6b3a128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d72c51-d959-40a5-85fb-484d8d2c86a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d72c51-d959-40a5-85fb-484d8d2c86a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a71a6b5-8b52-4474-8527-5167e9d3c3de', 'volume_name': 'volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3c7e4e-358c-4603-9676-eab70a1f0ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3c7e4e-358c-4603-9676-eab70a1f0ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeb2b50-ddef-4476-9fa7-7475f02ac33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Volume 3a71a6b5-8b52-4474-8527-5167e9d3c3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de', 'volume_size': 1} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-279801132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a71a6b5-8b52-4474-8527-5167e9d3c3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6056a8464040dea583578c0de18e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:17Z,use_quota=True,user_id='35db62230d96457f89b351c0227fe098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Creating volume 3a71a6b5-8b52-4474-8527-5167e9d3c3de {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:17 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:17 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de 1073741824 Feb 27 22:28:17 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:17 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" returned: 1 in 0.542s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:17 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e Feb 27 22:28:17 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:18 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" returned: 0 in 0.479s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Lock "cinder-quobyte-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e" released by "delete_volume" :: held 1.661s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:18 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 0 in 0.901s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_nu5t5qm_devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:28:18 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Converted 112.00 MB image at 112.00 MB/s Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Created reservations ['a98058ef-30f3-44c9-983c-8a1e6501cb2b', '63934b52-e43d-4216-9c4c-0b1cfe72d9c9', 'e2acfbeb-e0c4-424d-a3cd-47a5ede3aea7', '517064ba-0626-49cc-82f7-cc4ab2a70f1b'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:18 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 1G Feb 27 22:28:18 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:18 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:18 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:18 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de 1073741824" returned: 0 in 0.676s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:18 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de Feb 27 22:28:18 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:18 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.420s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:18 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:18 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Deleted volume successfully. Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 1G" returned: 0 in 0.521s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-636927ac-fc82-4c76-bb6f-c5e25036db26 tempest-VolumesGetTest-194305358 None] Lock "cinder-e4dffee1-a11d-4551-b7f5-6d4e5da49a8e-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1fda2d-92c7-4efe-8df0-389e1d94a404]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:18 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de" returned: 0 in 0.484s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeb2b50-ddef-4476-9fa7-7475f02ac33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a890af-8c60-4dc2-a896-23b01c325964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:18 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Volume volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de (3a71a6b5-8b52-4474-8527-5167e9d3c3de): created successfully Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a890af-8c60-4dc2-a896-23b01c325964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Flow 'volume_create_manager' (cf984257-bec3-479b-81e2-b38b8123cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:18 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8551535e-62c8-44e9-a37d-ce295c1886ba tempest-VolumesListAdminTestJSON-1240256278 None] Created volume successfully. Feb 27 22:28:18 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:18 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:19 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 0 in 0.539s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:19 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:19 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:19 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 1 in 0.551s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Downloaded image b38627d9-9522-4831-a36d-1e8d5b5fd424 ((None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}])) to volume f6163aa5-a641-4cb9-9bb1-bd427dc169a1 successfully. {{(pid=83540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Temporary image b38627d9-9522-4831-a36d-1e8d5b5fd424 for user c82069541b0a4a23af3328b4f225cdc3 is deleted. {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Marking volume f6163aa5-a641-4cb9-9bb1-bd427dc169a1 as bootable. {{(pid=83540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Copying metadata from image b38627d9-9522-4831-a36d-1e8d5b5fd424 to f6163aa5-a641-4cb9-9bb1-bd427dc169a1. {{(pid=83540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Creating volume glance metadata for volume f6163aa5-a641-4cb9-9bb1-bd427dc169a1 backed by image b38627d9-9522-4831-a36d-1e8d5b5fd424 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51567cf-c19f-48ac-9991-8e64b0e52d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:19 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d814aa-7392-4b5d-b7d8-723f66b73745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:19 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Volume volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 (f6163aa5-a641-4cb9-9bb1-bd427dc169a1): created successfully Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d814aa-7392-4b5d-b7d8-723f66b73745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Flow 'volume_create_manager' (6b10f8e1-b0fd-4163-9856-6c0534a8a56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:20 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d069fa6d-eb13-4b73-a96b-417d972ecd4a tempest-VolumesExtendTest-168678566 None] Created volume successfully. Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Flow 'volume_create_manager' (937c13fd-7966-47b7-afd2-e99bef56b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfafe83-c613-476d-8398-24b0dad38618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfafe83-c613-476d-8398-24b0dad38618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750329822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1808bd05-91e7-4d73-9616-06eca4ed46f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6056a8464040dea583578c0de18e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:20Z,use_quota=True,user_id='35db62230d96457f89b351c0227fe098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e509d95-3c39-4889-a938-c55788fd07cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e509d95-3c39-4889-a938-c55788fd07cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de96f7d4-bafd-474f-bbe4-e4671afa93b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de96f7d4-bafd-474f-bbe4-e4671afa93b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1808bd05-91e7-4d73-9616-06eca4ed46f5', 'volume_name': 'volume-1808bd05-91e7-4d73-9616-06eca4ed46f5', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3952b14-9459-4a67-9ff1-f51e1b503b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3952b14-9459-4a67-9ff1-f51e1b503b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e98f7b-76e6-4a30-8cc1-364fdeb1f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:20 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Volume 1808bd05-91e7-4d73-9616-06eca4ed46f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1808bd05-91e7-4d73-9616-06eca4ed46f5', 'volume_size': 1} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750329822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1808bd05-91e7-4d73-9616-06eca4ed46f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6056a8464040dea583578c0de18e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:20Z,use_quota=True,user_id='35db62230d96457f89b351c0227fe098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Creating volume 1808bd05-91e7-4d73-9616-06eca4ed46f5 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:20 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:20 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 1073741824 Feb 27 22:28:20 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:20 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 1073741824" returned: 0 in 0.560s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:20 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 Feb 27 22:28:20 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:21 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5" returned: 0 in 0.591s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.163s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e98f7b-76e6-4a30-8cc1-364fdeb1f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1808bd05-91e7-4d73-9616-06eca4ed46f5', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554ccb22-3f71-4ff1-af2c-87837429811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[82256194-c627-49f8-b833-c4815a2b05be]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:21 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Volume volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 (1808bd05-91e7-4d73-9616-06eca4ed46f5): created successfully Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554ccb22-3f71-4ff1-af2c-87837429811e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Flow 'volume_create_manager' (937c13fd-7966-47b7-afd2-e99bef56b073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:21 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-962dc535-d8a1-4b76-90e2-d1aca9023e9d tempest-VolumesListAdminTestJSON-1240256278 None] Created volume successfully. Feb 27 22:28:21 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:21 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:21 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 0 in 0.584s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:22 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:22 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Flow 'volume_create_manager' (a6c6f43e-10d0-4192-a10d-0ff280af1a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b367fe-1af9-4907-be04-d3dcab2a1617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b367fe-1af9-4907-be04-d3dcab2a1617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1607106815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf81109-0dc7-4571-8f62-fd3256ceca96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6056a8464040dea583578c0de18e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:22Z,use_quota=True,user_id='35db62230d96457f89b351c0227fe098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3fbb54-292f-400d-8eb6-c7e6efb4189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3fbb54-292f-400d-8eb6-c7e6efb4189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c702f6e6-034c-4104-8479-7b8434c86e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c702f6e6-034c-4104-8479-7b8434c86e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf81109-0dc7-4571-8f62-fd3256ceca96', 'volume_name': 'volume-ddf81109-0dc7-4571-8f62-fd3256ceca96', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fb44f1-fc6e-48fb-ab2d-5cddb274096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:22 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fb44f1-fc6e-48fb-ab2d-5cddb274096f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7d1082-d502-433f-9b39-a288f800b63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:22 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Volume ddf81109-0dc7-4571-8f62-fd3256ceca96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf81109-0dc7-4571-8f62-fd3256ceca96', 'volume_size': 1} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 1 in 0.578s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 2G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 2G" returned: 0 in 0.045s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.249s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.059s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1607106815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf81109-0dc7-4571-8f62-fd3256ceca96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6056a8464040dea583578c0de18e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:22Z,use_quota=True,user_id='35db62230d96457f89b351c0227fe098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Creating volume ddf81109-0dc7-4571-8f62-fd3256ceca96 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:22 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:22 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 1073741824 Feb 27 22:28:22 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:22 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-21ab5e4c-0983-45e6-b268-ab6a600e4b43 tempest-VolumesExtendTest-168678566 None] Extend volume completed successfully. Feb 27 22:28:23 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 1073741824" returned: 0 in 0.586s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:23 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 Feb 27 22:28:23 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Acquiring lock "cinder-f6163aa5-a641-4cb9-9bb1-bd427dc169a1-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Lock "cinder-f6163aa5-a641-4cb9-9bb1-bd427dc169a1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Acquiring lock "cinder-quobyte-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Lock "cinder-quobyte-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" acquired by "delete_volume" :: waited 0.006s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aaaca8-fedf-4630-b662-f6f84905e0f6]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:23 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:23 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:23 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96" returned: 0 in 0.521s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7d1082-d502-433f-9b39-a288f800b63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf81109-0dc7-4571-8f62-fd3256ceca96', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ffab86-94f6-4456-b4a8-7b80345e7b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:23 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Volume volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 (ddf81109-0dc7-4571-8f62-fd3256ceca96): created successfully Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ffab86-94f6-4456-b4a8-7b80345e7b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Flow 'volume_create_manager' (a6c6f43e-10d0-4192-a10d-0ff280af1a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:23 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-46b2466c-b162-4cbe-9cdd-9580c8cc6d39 tempest-VolumesListAdminTestJSON-1240256278 None] Created volume successfully. Feb 27 22:28:24 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 0 in 0.500s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:24 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:24 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:24 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 1 in 0.616s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:24 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1 Feb 27 22:28:24 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Flow 'volume_create_manager' (6ad58464-a6b4-4bd7-9681-75f2b6c21b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadf9d8e-a03f-436e-bd4b-0f5cfdb0c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadf9d8e-a03f-436e-bd4b-0f5cfdb0c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec849d4-e847-47d1-b451-cb56d8510a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6ebd161bdb4449bd9d4e7a61b3540c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:25Z,use_quota=True,user_id='2424cedf903d412a9cf29f0ec1445396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f04aab-7572-471a-a471-089617d7d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f04aab-7572-471a-a471-089617d7d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c0bf74-2220-4dca-8633-1c9d2e272214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c0bf74-2220-4dca-8633-1c9d2e272214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec849d4-e847-47d1-b451-cb56d8510a7a', 'volume_name': 'volume-0ec849d4-e847-47d1-b451-cb56d8510a7a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d26e72-dd2e-4e45-956d-4bc54d8da158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d26e72-dd2e-4e45-956d-4bc54d8da158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6423b439-effd-4004-86bb-90605b785b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:25 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Volume 0ec849d4-e847-47d1-b451-cb56d8510a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec849d4-e847-47d1-b451-cb56d8510a7a', 'volume_size': 1} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec849d4-e847-47d1-b451-cb56d8510a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6ebd161bdb4449bd9d4e7a61b3540c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:25Z,use_quota=True,user_id='2424cedf903d412a9cf29f0ec1445396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Creating volume 0ec849d4-e847-47d1-b451-cb56d8510a7a {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:25 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:25 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" returned: 0 in 0.489s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:25 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a 1073741824 Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Lock "cinder-quobyte-f6163aa5-a641-4cb9-9bb1-bd427dc169a1" released by "delete_volume" :: held 1.660s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:25 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Created reservations ['915e091d-02bb-489a-83a3-f8955df343b3', '15b1b99b-f6ff-4cdd-82c4-4def2d582d57', '8d5c6767-38f1-40dd-9173-c8b22e2b0f14', 'f935d701-03e8-45d7-a6b8-59a0b4255d33'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:25 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:25 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:25 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.466s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:25 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:25 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Deleted volume successfully. Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a 1073741824" returned: 0 in 0.615s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f992317d-5cf2-4b07-8743-96e93b71e7a2 tempest-VolumesExtendTest-168678566 None] Lock "cinder-f6163aa5-a641-4cb9-9bb1-bd427dc169a1-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:25 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a Feb 27 22:28:25 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Flow 'volume_create_manager' (b7516d6f-6d70-4467-b3a4-4570c580b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d312695d-da19-4a78-a502-f1fc7592ec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d312695d-da19-4a78-a502-f1fc7592ec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1084908477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bc6aa3-1d03-4c13-80a9-ce3a37446e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b110e0b4f484699004dd464b29bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:26Z,use_quota=True,user_id='c82069541b0a4a23af3328b4f225cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d87a1e4-f41f-4063-b67f-fc58c726d553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d87a1e4-f41f-4063-b67f-fc58c726d553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3fced3-055c-47f1-9834-8b29970a4137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3fced3-055c-47f1-9834-8b29970a4137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39bc6aa3-1d03-4c13-80a9-ce3a37446e95', 'volume_name': 'volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e089d4d-8276-4291-b965-399d85993fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e089d4d-8276-4291-b965-399d85993fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3369bbe3-6268-4aed-82c9-0fced24759d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:26 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Volume 39bc6aa3-1d03-4c13-80a9-ce3a37446e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95', 'volume_size': 1} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:26 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a" returned: 0 in 0.496s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.212s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1084908477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bc6aa3-1d03-4c13-80a9-ce3a37446e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b110e0b4f484699004dd464b29bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:26Z,use_quota=True,user_id='c82069541b0a4a23af3328b4f225cdc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Creating volume 39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:26 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6423b439-effd-4004-86bb-90605b785b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec849d4-e847-47d1-b451-cb56d8510a7a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3c2768-f4da-474a-9d05-ccc4338a14ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:26 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 1073741824 Feb 27 22:28:26 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:26 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Volume volume-0ec849d4-e847-47d1-b451-cb56d8510a7a (0ec849d4-e847-47d1-b451-cb56d8510a7a): created successfully Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3c2768-f4da-474a-9d05-ccc4338a14ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Flow 'volume_create_manager' (6ad58464-a6b4-4bd7-9681-75f2b6c21b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:26 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-736409a3-1df5-43ff-b0df-9e4347223798 tempest-VolumesListAdminTestJSON-1582406111 None] Created volume successfully. Feb 27 22:28:26 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 1073741824" returned: 0 in 0.552s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:26 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 Feb 27 22:28:26 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:27 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" returned: 0 in 0.409s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3369bbe3-6268-4aed-82c9-0fced24759d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3236c23-7c81-4340-a9e0-c10eef6ada2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Acquiring lock "cinder-0ec849d4-e847-47d1-b451-cb56d8510a7a-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:27 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Volume volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 (39bc6aa3-1d03-4c13-80a9-ce3a37446e95): created successfully Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3236c23-7c81-4340-a9e0-c10eef6ada2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Flow 'volume_create_manager' (b7516d6f-6d70-4467-b3a4-4570c580b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "cinder-0ec849d4-e847-47d1-b451-cb56d8510a7a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:27 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ce565c07-a1fc-496b-b285-7c99e103bdfd tempest-VolumesExtendTest-168678566 None] Created volume successfully. Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Acquiring lock "cinder-quobyte-0ec849d4-e847-47d1-b451-cb56d8510a7a" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "cinder-ddf81109-0dc7-4571-8f62-fd3256ceca96-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "cinder-quobyte-0ec849d4-e847-47d1-b451-cb56d8510a7a" acquired by "delete_volume" :: waited 0.029s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-ddf81109-0dc7-4571-8f62-fd3256ceca96-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ad8f84-286e-4359-99be-4a3cfe078fd6]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "cinder-quobyte-ddf81109-0dc7-4571-8f62-fd3256ceca96" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-quobyte-ddf81109-0dc7-4571-8f62-fd3256ceca96" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7138c3-7061-430c-a2c9-f6d8ef5fb6bc]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:27 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a Feb 27 22:28:27 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:27 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 Feb 27 22:28:27 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:28 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a" returned: 0 in 0.587s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:28 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a Feb 27 22:28:28 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:28 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96" returned: 0 in 0.689s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:28 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96 Feb 27 22:28:28 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Creating offline snapshot 9202d39e-1aff-4df3-a929-089f31e09381 of volume 39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c431233-db18-480f-8894-26c7c41591bb]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:28 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 Feb 27 22:28:28 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:28 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0ec849d4-e847-47d1-b451-cb56d8510a7a" returned: 0 in 0.581s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "cinder-quobyte-0ec849d4-e847-47d1-b451-cb56d8510a7a" released by "delete_volume" :: held 1.199s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Created reservations ['d3e1d2bc-625e-4909-87fa-cd7999123285', '8f8bda02-28de-4c75-86cb-f13cc5ea704d', '294b9762-a9f1-45c3-aff5-ef49485f5da6', '7452179b-3cdf-463c-a7fe-a882aa00051b'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:28 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:28 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:28 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ddf81109-0dc7-4571-8f62-fd3256ceca96" returned: 0 in 0.659s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-quobyte-ddf81109-0dc7-4571-8f62-fd3256ceca96" released by "delete_volume" :: held 1.377s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:28 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Created reservations ['ada595b0-b91e-45cb-9bb7-ca19c3d61d05', 'd5ab1673-1a77-4efb-83c4-a1609df86664', 'f0a72e76-61d9-4a80-a01a-8b12133f40e1', 'd6862f9c-d3dc-41dd-968b-086737d780b2'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:29 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:29 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:29 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" returned: 0 in 0.899s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:29 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 1G Feb 27 22:28:29 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:29 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.472s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Deleted volume successfully. Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6954c0fd-7ce4-478f-8540-90070a868848 tempest-VolumesListAdminTestJSON-1582406111 None] Lock "cinder-0ec849d4-e847-47d1-b451-cb56d8510a7a-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:29 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.480s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Deleted volume successfully. Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (cccabecc-fe86-4561-ba34-6f0df83586a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617cd161-48f0-4e0e-a0ec-c991660a1690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617cd161-48f0-4e0e-a0ec-c991660a1690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-278683528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f491cf1-9f2c-4950-8eb6-8b201b72f53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290998410794282a8e5bfa8c027f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:29Z,use_quota=True,user_id='d5f5d4b141a3415fab7ef2aa3f8e9327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e016657a-28bf-4048-aa67-502ee7577680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e016657a-28bf-4048-aa67-502ee7577680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcbf00e-6753-4e1a-b52e-80cc2e7f494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcbf00e-6753-4e1a-b52e-80cc2e7f494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f491cf1-9f2c-4950-8eb6-8b201b72f53d', 'volume_name': 'volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f3ff3e-6d66-4da2-a1b1-584923298f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f3ff3e-6d66-4da2-a1b1-584923298f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0557f5cb-3e6b-4e09-9de0-b0f41f36bd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:29 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume 1f491cf1-9f2c-4950-8eb6-8b201b72f53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d', 'volume_size': 1} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0fd4b7e5-0c4b-45cd-8738-8efaa74ddcc8 tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-ddf81109-0dc7-4571-8f62-fd3256ceca96-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "cinder-1808bd05-91e7-4d73-9616-06eca4ed46f5-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-1808bd05-91e7-4d73-9616-06eca4ed46f5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "cinder-quobyte-1808bd05-91e7-4d73-9616-06eca4ed46f5" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-quobyte-1808bd05-91e7-4d73-9616-06eca4ed46f5" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9cabfc-b14f-4b57-9413-083607a5a6e3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:29 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 1G" returned: 0 in 0.572s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:29 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 Feb 27 22:28:29 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:29 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 Feb 27 22:28:29 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:30 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381" returned: 0 in 0.429s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:30 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 is being set with open permissions: ugo+rw Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:30 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 Feb 27 22:28:30 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:30 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5" returned: 0 in 0.514s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:30 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5 Feb 27 22:28:30 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:30 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381" returned: 0 in 0.420s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:30 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.info Feb 27 22:28:30 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:30 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1808bd05-91e7-4d73-9616-06eca4ed46f5" returned: 0 in 0.451s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-quobyte-1808bd05-91e7-4d73-9616-06eca4ed46f5" released by "delete_volume" :: held 1.001s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Created reservations ['4dc0c406-ebb1-4543-84f3-2bad0e23f55b', 'b86ebf62-3464-4c6b-9479-4c0c77cebace', '474d5bb9-667f-4d45-85fd-92574562e40a', '684abe74-91e3-4844-8144-b3f83d6a4ba1'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:30 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:30 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:31 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.info" returned: 0 in 0.443s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:31 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.info is being set with open permissions: ugo+rw Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:31 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.info Feb 27 22:28:31 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:31 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.396s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:31 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Deleted volume successfully. Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6b315b29-3ff0-47bf-92a3-1a561706fc7a tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-1808bd05-91e7-4d73-9616-06eca4ed46f5-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:31 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.info" returned: 0 in 0.428s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.265s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.999s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-278683528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f491cf1-9f2c-4950-8eb6-8b201b72f53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290998410794282a8e5bfa8c027f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:29Z,use_quota=True,user_id='d5f5d4b141a3415fab7ef2aa3f8e9327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Creating volume 1f491cf1-9f2c-4950-8eb6-8b201b72f53d {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:31 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:31 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d 1073741824 Feb 27 22:28:31 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:31 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c1814aff-f80d-43d1-abfd-9c730a221f51 tempest-VolumesExtendTest-168678566 None] Create snapshot completed successfully Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "cinder-3a71a6b5-8b52-4474-8527-5167e9d3c3de-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-3a71a6b5-8b52-4474-8527-5167e9d3c3de-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "cinder-quobyte-3a71a6b5-8b52-4474-8527-5167e9d3c3de" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-quobyte-3a71a6b5-8b52-4474-8527-5167e9d3c3de" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c538c1-4591-4104-b9fc-df5e62812ba7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:32 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de Feb 27 22:28:32 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:32 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d 1073741824" returned: 0 in 0.518s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:32 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d Feb 27 22:28:32 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3b26f867-ba26-4efe-bbf2-30871ab9c36a tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:32 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" returned: 0 in 0.426s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:32 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3b26f867-ba26-4efe-bbf2-30871ab9c36a tempest-VolumesExtendTest-168678566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.025s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=128,cinder:UPDATE=168,cinder:DELETE=15,cinder:INSERT=50 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de" returned: 0 in 0.565s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea2e4d6-1377-4fdc-9e19-d34efb8f483e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3b26f867-ba26-4efe-bbf2-30871ab9c36a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0557f5cb-3e6b-4e09-9de0-b0f41f36bd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed604775-dff3-4026-871f-b6970e2687ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:32 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de Feb 27 22:28:32 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:32 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d (1f491cf1-9f2c-4950-8eb6-8b201b72f53d): created successfully Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed604775-dff3-4026-871f-b6970e2687ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (cccabecc-fe86-4561-ba34-6f0df83586a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:32 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b8e08f6f-a366-4e35-8651-ce2d59682b70 tempest-VolumesSnapshotTestJSON-1575833507 None] Created volume successfully. Feb 27 22:28:32 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 Feb 27 22:28:32 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:32 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3a71a6b5-8b52-4474-8527-5167e9d3c3de" returned: 0 in 0.424s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-quobyte-3a71a6b5-8b52-4474-8527-5167e9d3c3de" released by "delete_volume" :: held 1.012s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Created reservations ['4bf62167-ccd2-4a3c-9e65-7c1a667dba80', '0425ee5e-3bfc-40a8-a02e-89f967cd6457', '0a53de0b-c995-4ef3-9d3a-60a934ac1fc0', '8420c643-0d2a-4b81-abf7-a6c8cb113ab7'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:33 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3b26f867-ba26-4efe-bbf2-30871ab9c36a tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" returned: 0 in 0.537s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3b26f867-ba26-4efe-bbf2-30871ab9c36a tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 2G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:33 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:33 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3b26f867-ba26-4efe-bbf2-30871ab9c36a tempest-VolumesExtendTest-168678566 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 2G" returned: 0 in 0.072s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3b26f867-ba26-4efe-bbf2-30871ab9c36a tempest-VolumesExtendTest-168678566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.643s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3b26f867-ba26-4efe-bbf2-30871ab9c36a tempest-VolumesExtendTest-168678566 None] Extend volume completed successfully. Feb 27 22:28:33 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.435s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Deleted volume successfully. Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-24a1bd00-cc4e-497e-ab2d-9004a9d47d9c tempest-VolumesListAdminTestJSON-1240256278 None] Lock "cinder-3a71a6b5-8b52-4474-8527-5167e9d3c3de-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Acquiring lock "cinder-9202d39e-1aff-4df3-a929-089f31e09381-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Lock "cinder-9202d39e-1aff-4df3-a929-089f31e09381-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Acquiring lock "cinder-quobyte-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Lock "cinder-quobyte-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Acquiring lock "cinder-quobyte-9202d39e-1aff-4df3-a929-089f31e09381" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Lock "cinder-quobyte-9202d39e-1aff-4df3-a929-089f31e09381" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Deleting offline snapshot 9202d39e-1aff-4df3-a929-089f31e09381 of volume 39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] snapshot_file for this snap is: volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee248f1d-1eeb-446a-bf42-4d03f74f8041]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:33 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 Feb 27 22:28:33 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Creating offline snapshot daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a of volume 1f491cf1-9f2c-4950-8eb6-8b201b72f53d {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dcc40a-e7a1-418c-b73e-92dbf1da3dac]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:34 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d Feb 27 22:28:34 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:34 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381" returned: 0 in 0.577s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:28:34 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b9523f-0a91-4806-a5d5-b1fe74140019]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:34 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 Feb 27 22:28:34 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:34 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" returned: 0 in 0.603s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:34 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a 1G Feb 27 22:28:34 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:35 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" returned: 0 in 0.619s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:35 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 Feb 27 22:28:35 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:35 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a 1G" returned: 0 in 0.579s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:35 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a Feb 27 22:28:35 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:35 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381" returned: 0 in 0.568s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:35 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381 Feb 27 22:28:35 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:35 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a" returned: 0 in 0.562s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:35 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a is being set with open permissions: ugo+rw Feb 27 22:28:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:35 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a Feb 27 22:28:35 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:36 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95.9202d39e-1aff-4df3-a929-089f31e09381" returned: 0 in 0.537s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Lock "cinder-quobyte-9202d39e-1aff-4df3-a929-089f31e09381" released by "_delete_snapshot" :: held 2.373s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Lock "cinder-quobyte-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" released by "delete_snapshot" :: held 2.387s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Created reservations ['5c923b80-5343-4a16-8147-e6e93503aa31', '76bd28fa-2078-407e-aa53-e4a309cccdf5', '7eba4664-46b4-4dff-89b5-110606e9e59d', 'd788f00e-2cbb-45f5-97cf-70c4fca048a9'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:36 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a" returned: 0 in 0.568s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:36 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Delete snapshot completed successfully. Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0e25e1ef-7dec-483e-bb92-c27f7d3f7e83 tempest-VolumesExtendTest-168678566 None] Lock "cinder-9202d39e-1aff-4df3-a929-089f31e09381-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:36 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.info Feb 27 22:28:36 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:36 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.info" returned: 0 in 0.545s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:36 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.info is being set with open permissions: ugo+rw Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:36 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.info Feb 27 22:28:36 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Acquiring lock "cinder-39bc6aa3-1d03-4c13-80a9-ce3a37446e95-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Lock "cinder-39bc6aa3-1d03-4c13-80a9-ce3a37446e95-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Acquiring lock "cinder-quobyte-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Lock "cinder-quobyte-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026b778-c31a-4144-8e45-629ebd85183c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:37 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 Feb 27 22:28:37 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Flow 'volume_create_manager' (2064855e-eb32-4f3b-a176-6f816e1d0e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fc94c6-8ff6-4e24-b0a3-0b00ed4a2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fc94c6-8ff6-4e24-b0a3-0b00ed4a2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-548176929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdd659f-cbf6-407c-be02-d57fbb48f9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76f6fec2eec43de85d064b8ba7f42e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:37Z,use_quota=True,user_id='acea0534c8484c75bec4b4ad125fb9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d27671f-ef5f-472b-b447-7bdb2ca5e96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d27671f-ef5f-472b-b447-7bdb2ca5e96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a2960e-a08d-4dea-a3a2-226c87656f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.image.glance [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Creating Keystone auth plugin from conf {{(pid=83540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 22:28:37 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.info" returned: 0 in 0.551s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.468s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:37 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-278f0b43-914c-4a6d-b4eb-a3f1a061df92 tempest-VolumesSnapshotTestJSON-1575833507 None] Create snapshot completed successfully Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a2960e-a08d-4dea-a3a2-226c87656f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7cdd659f-cbf6-407c-be02-d57fbb48f9e1', 'volume_name': 'volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036fc1f0-e5a1-431b-9352-53f603b6e716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036fc1f0-e5a1-431b-9352-53f603b6e716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5decae9-26d2-4ee4-ae07-afa30833f380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:37 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Volume 7cdd659f-cbf6-407c-be02-d57fbb48f9e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Trying to clone 7cdd659f-cbf6-407c-be02-d57fbb48f9e1 from image b38627d9-9522-4831-a36d-1e8d5b5fd424 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]). {{(pid=83540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 22:28:37 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Image download 20.69 MB at 20.69 MB/s Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2c6b3-3a16-4280-a4a0-1957ac92b395]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:37 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" returned: 0 in 0.641s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:37 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95 Feb 27 22:28:37 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:37 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD Feb 27 22:28:37 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:38 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" returned: 0 in 0.482s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:38 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD" returned: 0 in 0.526s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Temporary image b38627d9-9522-4831-a36d-1e8d5b5fd424 is fetched for user acea0534c8484c75bec4b4ad125fb9a2. {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Lock "cinder-quobyte-39bc6aa3-1d03-4c13-80a9-ce3a37446e95" released by "delete_volume" :: held 1.195s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Deleting offline snapshot daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a of volume 1f491cf1-9f2c-4950-8eb6-8b201b72f53d {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] snapshot_file for this snap is: volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f8bd64-41dc-4b9b-9565-e468590fc27e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Created reservations ['82e229d6-02ff-4c49-a9b7-4235948057bd', '39e7825b-e678-4f9e-a9c2-67db3966ccdd', 'b9c39391-daad-4bdc-a84c-582775ed88c0', '1216764d-6cd3-4608-b7a7-4cdca21e777b'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:38 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a Feb 27 22:28:38 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1916f8d9-d0b5-43e8-9b5d-d671af1df3fc]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:38 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD Feb 27 22:28:38 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:38 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:38 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:38 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a" returned: 0 in 0.542s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[410139b0-054f-404f-8516-3681557f72ad]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:38 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD" returned: 0 in 0.549s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:39 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-548176929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdd659f-cbf6-407c-be02-d57fbb48f9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76f6fec2eec43de85d064b8ba7f42e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:37Z,use_quota=True,user_id='acea0534c8484c75bec4b4ad125fb9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Creating volume 7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:39 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:39 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:39 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.482s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:39 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Deleted volume successfully. Feb 27 22:28:39 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 1073741824 Feb 27 22:28:39 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-751bf0b6-0de7-4a80-9d20-55d2372f8229 tempest-VolumesExtendTest-168678566 None] Lock "cinder-39bc6aa3-1d03-4c13-80a9-ce3a37446e95-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:39 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" returned: 0 in 0.613s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:39 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a Feb 27 22:28:39 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:39 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 1073741824" returned: 0 in 0.596s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:39 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 Feb 27 22:28:39 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:40 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a" returned: 0 in 0.582s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:40 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" returned: 0 in 0.497s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:40 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a Feb 27 22:28:40 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Attempting download of b38627d9-9522-4831-a36d-1e8d5b5fd424 ((None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}])) to volume 7cdd659f-cbf6-407c-be02-d57fbb48f9e1. {{(pid=83540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3df5d-cd04-4199-bbbd-c91a5accc7f4]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_47fy_1_p {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:40 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_47fy_1_p Feb 27 22:28:40 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:40 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d.daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a" returned: 0 in 0.529s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a" released by "_delete_snapshot" :: held 2.335s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" released by "delete_snapshot" :: held 2.347s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Created reservations ['28b0d92f-7204-4605-8054-ae6a7e2d7ba7', '701c1d9a-e852-4677-afe0-a15a24083256', 'a9d4516d-925e-4977-8178-fe82bdff73ff', '088f9054-cc09-4b98-939c-21660f033a6a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:40 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_47fy_1_p" returned: 0 in 0.571s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_47fy_1_p {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:40 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Delete snapshot completed successfully. Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cf15f7b5-aa15-4170-8e0d-e9cd253584a0 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-daa6b6d2-f5a0-4a6e-bcaf-77329c28fb9a-delete_snapshot" released by "delete_snapshot" :: held 2.542s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:40 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_47fy_1_p Feb 27 22:28:40 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:40 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:40 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:41 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_47fy_1_p" returned: 1 in 0.505s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b38627d9-9522-4831-a36d-1e8d5b5fd424_47fy_1_p' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ae1f04-6ee6-461f-a92f-cee291a2a9a2]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:41 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD Feb 27 22:28:41 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:41 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.477s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:28:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:28:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:28:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:28:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:28:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:28:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (8acdd8e5-9324-4de4-9437-87fe5b7152b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb0220a-da35-49ae-8615-b0db667c85a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb0220a-da35-49ae-8615-b0db667c85a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-899318939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba630f60-a947-4a5c-ba18-097da3fd857c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290998410794282a8e5bfa8c027f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:42Z,use_quota=True,user_id='d5f5d4b141a3415fab7ef2aa3f8e9327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd073f7-eabb-4d73-98e3-22f6791e7510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd073f7-eabb-4d73-98e3-22f6791e7510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463549e9-4938-487f-9333-d61524cdad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463549e9-4938-487f-9333-d61524cdad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba630f60-a947-4a5c-ba18-097da3fd857c', 'volume_name': 'volume-ba630f60-a947-4a5c-ba18-097da3fd857c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c41e8f-2d21-454d-affb-187d4c8e5eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c41e8f-2d21-454d-affb-187d4c8e5eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21443797-0dee-4831-ad07-f65d1179e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:41 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Volume ba630f60-a947-4a5c-ba18-097da3fd857c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba630f60-a947-4a5c-ba18-097da3fd857c', 'volume_size': 1} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-899318939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba630f60-a947-4a5c-ba18-097da3fd857c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290998410794282a8e5bfa8c027f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:42Z,use_quota=True,user_id='d5f5d4b141a3415fab7ef2aa3f8e9327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Creating volume ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:41 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:41 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c 1073741824 Feb 27 22:28:41 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:41 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD" returned: 0 in 0.642s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] b38627d9-9522-4831-a36d-1e8d5b5fd424 was qcow2, converting to raw {{(pid=83540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 22:28:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:41 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 Feb 27 22:28:41 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:42 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c 1073741824" returned: 0 in 0.671s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:42 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c Feb 27 22:28:42 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:42 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" returned: 0 in 1.043s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:42 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b38627d9-9522-4831-a36d-1e8d5b5fd424_p9kwiit9devstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:28:42 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Converted 112.00 MB image at 107.30 MB/s Feb 27 22:28:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:43 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c" returned: 0 in 0.450s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:43 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 1G Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:43 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21443797-0dee-4831-ad07-f65d1179e042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba630f60-a947-4a5c-ba18-097da3fd857c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c83c8a-ede0-4ad1-8207-74855a8dd2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:43 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Volume volume-ba630f60-a947-4a5c-ba18-097da3fd857c (ba630f60-a947-4a5c-ba18-097da3fd857c): created successfully Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c83c8a-ede0-4ad1-8207-74855a8dd2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (8acdd8e5-9324-4de4-9437-87fe5b7152b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:43 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-fdbee002-24ff-49bc-a6af-f29bb5067a9f tempest-VolumesSnapshotTestJSON-1575833507 None] Created volume successfully. Feb 27 22:28:43 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 1G" returned: 0 in 0.419s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdea265-5466-4735-b36a-0787dc7263c8]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:43 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 Feb 27 22:28:43 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:43 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" returned: 0 in 0.467s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:43 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 Feb 27 22:28:43 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Creating offline snapshot ccd5376c-e0c0-4331-acca-272616865e8c of volume ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f2e9f2-fb72-480e-b7f8-d96c16ffe5d1]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:44 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c Feb 27 22:28:44 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:44 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" returned: 1 in 0.477s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Downloaded image b38627d9-9522-4831-a36d-1e8d5b5fd424 ((None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}])) to volume 7cdd659f-cbf6-407c-be02-d57fbb48f9e1 successfully. {{(pid=83540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Temporary image b38627d9-9522-4831-a36d-1e8d5b5fd424 for user acea0534c8484c75bec4b4ad125fb9a2 is deleted. {{(pid=83540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.volume_utils [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Marking volume 7cdd659f-cbf6-407c-be02-d57fbb48f9e1 as bootable. {{(pid=83540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Copying metadata from image b38627d9-9522-4831-a36d-1e8d5b5fd424 to 7cdd659f-cbf6-407c-be02-d57fbb48f9e1. {{(pid=83540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Creating volume glance metadata for volume 7cdd659f-cbf6-407c-be02-d57fbb48f9e1 backed by image b38627d9-9522-4831-a36d-1e8d5b5fd424 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5decae9-26d2-4ee4-ae07-afa30833f380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1', 'volume_size': 1, 'image_id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b38627d9-9522-4831-a36d-1e8d5b5fd424', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db2cdbc459ec494ca958b2ff32a255a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b38627d9-9522-4831-a36d-1e8d5b5fd424', 'created_at': datetime.datetime(2026, 2, 27, 21, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 21, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b38627d9-9522-4831-a36d-1e8d5b5fd424/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772be355-c703-4f92-9317-3633f18404eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Volume volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 (7cdd659f-cbf6-407c-be02-d57fbb48f9e1): created successfully Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772be355-c703-4f92-9317-3633f18404eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Flow 'volume_create_manager' (2064855e-eb32-4f3b-a176-6f816e1d0e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7c75c915-4cbe-472f-bd76-f5040c447d43 tempest-VolumesImageMetadata-839210575 None] Created volume successfully. Feb 27 22:28:44 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c" returned: 0 in 0.507s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:44 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c 1G Feb 27 22:28:44 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Acquiring lock "cinder-7cdd659f-cbf6-407c-be02-d57fbb48f9e1-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Lock "cinder-7cdd659f-cbf6-407c-be02-d57fbb48f9e1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Acquiring lock "cinder-quobyte-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Lock "cinder-quobyte-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b97ef2d-76a7-4ac8-b94b-53c3fb9e80b7]: (4, 'raw') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:45 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c 1G" returned: 0 in 0.554s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba630f60-a947-4a5c-ba18-097da3fd857c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:45 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba630f60-a947-4a5c-ba18-097da3fd857c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c Feb 27 22:28:45 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:45 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 Feb 27 22:28:45 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:45 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba630f60-a947-4a5c-ba18-097da3fd857c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c" returned: 0 in 0.443s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:45 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c is being set with open permissions: ugo+rw Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:45 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c Feb 27 22:28:45 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:45 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" returned: 0 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:45 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 Feb 27 22:28:45 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:45 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c" returned: 0 in 0.399s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:45 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.info Feb 27 22:28:45 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:46 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" returned: 1 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1' failed. Not Retrying. {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:46 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1 Feb 27 22:28:46 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:46 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.info" returned: 0 in 0.430s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:46 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.info is being set with open permissions: ugo+rw Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:46 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.info Feb 27 22:28:46 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:46 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" returned: 0 in 0.406s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Lock "cinder-quobyte-7cdd659f-cbf6-407c-be02-d57fbb48f9e1" released by "delete_volume" :: held 1.424s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Created reservations ['2a70c146-e294-4660-909d-0c5e148739fc', 'f38b3509-7f23-4a1d-81c6-79f650b8742d', '016a0b75-dc70-4e9e-b4d0-486c079a6c0e', 'a0547838-c697-40ce-815b-cd918c054ef9'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:46 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:46 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:46 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.info" returned: 0 in 0.413s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.806s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-da3142c1-4c34-4ba9-a2e7-a43a0d4dad19 tempest-VolumesSnapshotTestJSON-1575833507 None] Create snapshot completed successfully Feb 27 22:28:46 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.429s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Deleted volume successfully. Feb 27 22:28:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-15517490-ec10-4c5e-86d9-be74c139bde4 tempest-VolumesImageMetadata-839210575 None] Lock "cinder-7cdd659f-cbf6-407c-be02-d57fbb48f9e1-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (fafda446-3d85-4b54-a94c-b725fb079ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22032cd1-4d81-4fc8-a567-3c1d0e04d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22032cd1-4d81-4fc8-a567-3c1d0e04d555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1955339630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd15155f-1f82-49b8-b127-123641ff558d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290998410794282a8e5bfa8c027f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ccd5376c-e0c0-4331-acca-272616865e8c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:47Z,use_quota=True,user_id='d5f5d4b141a3415fab7ef2aa3f8e9327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da839680-fcd6-4270-a935-69c57165f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da839680-fcd6-4270-a935-69c57165f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9201ebc5-1f88-4e0f-b0be-2d6b6a8407bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9201ebc5-1f88-4e0f-b0be-2d6b6a8407bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd15155f-1f82-49b8-b127-123641ff558d', 'volume_name': 'volume-fd15155f-1f82-49b8-b127-123641ff558d', 'volume_size': 2, 'snapshot_id': 'ccd5376c-e0c0-4331-acca-272616865e8c'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e61fc8c-9dac-4299-aa08-be0b2992be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e61fc8c-9dac-4299-aa08-be0b2992be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10629a40-c397-449c-8c8b-ff52c81206b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:47 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Volume fd15155f-1f82-49b8-b127-123641ff558d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd15155f-1f82-49b8-b127-123641ff558d', 'volume_size': 2, 'snapshot_id': 'ccd5376c-e0c0-4331-acca-272616865e8c'} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-ccd5376c-e0c0-4331-acca-272616865e8c-fd15155f-1f82-49b8-b127-123641ff558d" by "_create_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-ccd5376c-e0c0-4331-acca-272616865e8c-fd15155f-1f82-49b8-b127-123641ff558d" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Creating volume fd15155f-1f82-49b8-b127-123641ff558d from snapshot ccd5376c-e0c0-4331-acca-272616865e8c {{(pid=83540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-fd15155f-1f82-49b8-b127-123641ff558d" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-fd15155f-1f82-49b8-b127-123641ff558d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] snapshot: ccd5376c-e0c0-4331-acca-272616865e8c, volume: fd15155f-1f82-49b8-b127-123641ff558d, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[404adf0e-e805-44f2-bd56-9701437f4006]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:47 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c Feb 27 22:28:47 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:48 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c" returned: 0 in 0.601s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba630f60-a947-4a5c-ba18-097da3fd857c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a096c21b-6fce-4372-be4d-c49feea90162]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:48 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c Feb 27 22:28:48 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:48 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c" returned: 0 in 0.543s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:48 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d Feb 27 22:28:48 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Flow 'volume_create_manager' (e0e48ad3-468d-48b9-b316-226ad16886cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cccd00d-c20a-4a38-9306-4e062dc45a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cccd00d-c20a-4a38-9306-4e062dc45a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1878944054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e53bc49-7f1a-4091-b777-0e837ac5bc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f34cc5b1e314b46a5ed0d4c819ff072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:49Z,use_quota=True,user_id='3fa7096669ac4acd83c5a629a17b606f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a7e4cc-00df-484c-8808-67d21aecc370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a7e4cc-00df-484c-8808-67d21aecc370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2621bb8b-2ec6-42f6-ae13-c794126a63d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2621bb8b-2ec6-42f6-ae13-c794126a63d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e53bc49-7f1a-4091-b777-0e837ac5bc37', 'volume_name': 'volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6ecd1d-d084-40b2-8bed-62b34677fc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6ecd1d-d084-40b2-8bed-62b34677fc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae47a919-93e7-4f7a-9e7d-33b8fc93e5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:49 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Volume 2e53bc49-7f1a-4091-b777-0e837ac5bc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37', 'volume_size': 1} Feb 27 22:28:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:50 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d" returned: 0 in 2.018s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:50 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff4680-f3b4-4eed-925d-cb95f36cd601]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:50 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c Feb 27 22:28:50 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:51 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c" returned: 0 in 0.624s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:28:51 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Converted 1024.00 MB image at 507.15 MB/s Feb 27 22:28:51 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d is being set with open permissions: ugo+rw Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:51 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d Feb 27 22:28:51 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:51 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d" returned: 0 in 0.406s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-fd15155f-1f82-49b8-b127-123641ff558d" released by "_copy_volume_from_snapshot" :: held 4.271s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-ccd5376c-e0c0-4331-acca-272616865e8c-fd15155f-1f82-49b8-b127-123641ff558d" released by "_create_volume_from_snapshot" :: held 4.289s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.300s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.803s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1878944054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e53bc49-7f1a-4091-b777-0e837ac5bc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f34cc5b1e314b46a5ed0d4c819ff072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:49Z,use_quota=True,user_id='3fa7096669ac4acd83c5a629a17b606f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Creating volume 2e53bc49-7f1a-4091-b777-0e837ac5bc37 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:51 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:51 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 1073741824 Feb 27 22:28:51 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10629a40-c397-449c-8c8b-ff52c81206b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd15155f-1f82-49b8-b127-123641ff558d', 'volume_size': 2, 'snapshot_id': 'ccd5376c-e0c0-4331-acca-272616865e8c'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b605d6-7be0-4e3a-847d-10cd86d56795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:51 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Volume volume-fd15155f-1f82-49b8-b127-123641ff558d (fd15155f-1f82-49b8-b127-123641ff558d): created successfully Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b605d6-7be0-4e3a-847d-10cd86d56795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (fafda446-3d85-4b54-a94c-b725fb079ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:51 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9a332927-a1f2-4a26-b68b-01c4ff022ada tempest-VolumesSnapshotTestJSON-1575833507 None] Created volume successfully. Feb 27 22:28:52 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 1073741824" returned: 0 in 0.493s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:52 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 Feb 27 22:28:52 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:52 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37" returned: 0 in 0.421s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae47a919-93e7-4f7a-9e7d-33b8fc93e5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57328e5-cc7d-4084-a170-729217873441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:52 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Volume volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 (2e53bc49-7f1a-4091-b777-0e837ac5bc37): created successfully Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57328e5-cc7d-4084-a170-729217873441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Flow 'volume_create_manager' (e0e48ad3-468d-48b9-b316-226ad16886cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:52 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-416c8e92-e9ae-4c27-97a8-9716d3cd2749 tempest-SnapshotMetadataTestJSON-718297455 None] Created volume successfully. Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-fd15155f-1f82-49b8-b127-123641ff558d-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-fd15155f-1f82-49b8-b127-123641ff558d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-fd15155f-1f82-49b8-b127-123641ff558d" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-fd15155f-1f82-49b8-b127-123641ff558d" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aefa91a-77f6-45e0-94d5-fb591aad275e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:53 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d Feb 27 22:28:53 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:53 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d" returned: 0 in 0.477s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:53 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d Feb 27 22:28:53 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Creating offline snapshot 5f3f1020-cac9-4491-8a84-60a9c38a76c7 of volume 2e53bc49-7f1a-4091-b777-0e837ac5bc37 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce5a4c2-2e34-46bf-a9ea-b85f8dfdfae7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:53 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 Feb 27 22:28:53 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:53 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd15155f-1f82-49b8-b127-123641ff558d" returned: 0 in 0.420s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-fd15155f-1f82-49b8-b127-123641ff558d" released by "delete_volume" :: held 0.930s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Created reservations ['90ef6e41-fd92-4edf-8999-4c4fbf1d1df7', '2b8fd4c0-57d1-4a97-8f06-378b5dbb17c6', '216db52f-4ad8-4ada-b542-c318b0b5a7a7', 'aaecb1c3-01c0-4d02-abd3-edb50b65d164'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:53 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:53 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:54 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37" returned: 0 in 0.511s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:54 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 1G Feb 27 22:28:54 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-ccd5376c-e0c0-4331-acca-272616865e8c-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-ccd5376c-e0c0-4331-acca-272616865e8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-ba630f60-a947-4a5c-ba18-097da3fd857c" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-ba630f60-a947-4a5c-ba18-097da3fd857c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-ccd5376c-e0c0-4331-acca-272616865e8c" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-ccd5376c-e0c0-4331-acca-272616865e8c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Deleting offline snapshot ccd5376c-e0c0-4331-acca-272616865e8c of volume ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] snapshot_file for this snap is: volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee88e923-642b-49de-95d9-e4707c4f53ca]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:54 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c Feb 27 22:28:54 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:54 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.451s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:54 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Deleted volume successfully. Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-de253aca-3b81-4a85-95d4-b9ce25e7a0bd tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-fd15155f-1f82-49b8-b127-123641ff558d-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:54 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 1G" returned: 0 in 0.511s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:54 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 Feb 27 22:28:54 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:54 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c" returned: 0 in 0.515s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba630f60-a947-4a5c-ba18-097da3fd857c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[02890256-8b79-47dd-b14b-ed3e78e24e94]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:54 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c Feb 27 22:28:54 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:54 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7" returned: 0 in 0.443s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:54 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 is being set with open permissions: ugo+rw Feb 27 22:28:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:54 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 Feb 27 22:28:54 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:55 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c" returned: 0 in 0.504s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:55 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c Feb 27 22:28:55 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:55 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7" returned: 0 in 0.450s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:55 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.info Feb 27 22:28:55 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:55 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c" returned: 0 in 0.474s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:55 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c Feb 27 22:28:55 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:55 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.info" returned: 0 in 0.437s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:55 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.info is being set with open permissions: ugo+rw Feb 27 22:28:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:55 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.info Feb 27 22:28:55 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:56 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c.ccd5376c-e0c0-4331-acca-272616865e8c" returned: 0 in 0.423s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-ccd5376c-e0c0-4331-acca-272616865e8c" released by "_delete_snapshot" :: held 1.970s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-ba630f60-a947-4a5c-ba18-097da3fd857c" released by "delete_snapshot" :: held 1.984s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Created reservations ['17d0538b-4529-42a8-85d5-a08c8046fc28', 'bfa7f3a2-0ded-4554-b6d4-cebfe0b10a1b', 'eefc1786-3145-495c-ac8c-4a1d5df344c1', '20452d80-6aa9-4345-8441-8dfedaddb17b'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:56 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Delete snapshot completed successfully. Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-378b588b-c849-4e80-935c-7dacf57c61fb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-ccd5376c-e0c0-4331-acca-272616865e8c-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-ba630f60-a947-4a5c-ba18-097da3fd857c-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-ba630f60-a947-4a5c-ba18-097da3fd857c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-ba630f60-a947-4a5c-ba18-097da3fd857c" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-ba630f60-a947-4a5c-ba18-097da3fd857c" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d49597c-bfc1-4165-b372-201e81cce0f0]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:56 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.info" returned: 0 in 0.465s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.874s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:56 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9b674dbe-334c-48a8-bb12-4d0cf12721b6 tempest-SnapshotMetadataTestJSON-718297455 None] Create snapshot completed successfully Feb 27 22:28:56 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c Feb 27 22:28:56 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:56 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c" returned: 0 in 0.519s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:56 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c Feb 27 22:28:56 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "cinder-5f3f1020-cac9-4491-8a84-60a9c38a76c7-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-5f3f1020-cac9-4491-8a84-60a9c38a76c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "cinder-quobyte-2e53bc49-7f1a-4091-b777-0e837ac5bc37" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-quobyte-2e53bc49-7f1a-4091-b777-0e837ac5bc37" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "cinder-quobyte-5f3f1020-cac9-4491-8a84-60a9c38a76c7" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-quobyte-5f3f1020-cac9-4491-8a84-60a9c38a76c7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Deleting offline snapshot 5f3f1020-cac9-4491-8a84-60a9c38a76c7 of volume 2e53bc49-7f1a-4091-b777-0e837ac5bc37 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] snapshot_file for this snap is: volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41ac984-1bcb-44ff-ae65-29030d81218c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:57 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 Feb 27 22:28:57 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:57 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ba630f60-a947-4a5c-ba18-097da3fd857c" returned: 0 in 0.444s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-ba630f60-a947-4a5c-ba18-097da3fd857c" released by "delete_volume" :: held 0.995s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Created reservations ['24e73e44-f2e6-4721-b2ab-6db18acf8a50', 'c8253c8b-76e3-4a97-9a80-cca8294e777e', '1ee3e092-5e47-4054-ae27-fc491ecebded', '43da3d5c-2e2a-4190-b113-06a15f9a0d5a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:57 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:28:57 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:57 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7" returned: 0 in 0.484s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ca5d61-0d79-46e9-a232-971500a6c072]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:57 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 Feb 27 22:28:57 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:57 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.426s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:28:57 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Deleted volume successfully. Feb 27 22:28:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a15c9fdf-2c01-49b8-816e-e64eb10f5873 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-ba630f60-a947-4a5c-ba18-097da3fd857c-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:58 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37" returned: 0 in 0.466s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:58 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 Feb 27 22:28:58 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:58 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7" returned: 0 in 0.475s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:58 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7 Feb 27 22:28:58 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (faef3192-51df-4a39-8453-35779dcbe7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1adf464d-48ed-4bad-aef7-bc00496deefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1adf464d-48ed-4bad-aef7-bc00496deefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-150327029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d890fd83-fff6-440c-be42-2611e9d7d4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290998410794282a8e5bfa8c027f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:59Z,use_quota=True,user_id='d5f5d4b141a3415fab7ef2aa3f8e9327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ff5b31-0cc3-4635-bcb3-43f410287af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ff5b31-0cc3-4635-bcb3-43f410287af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31234305-d4ea-48e2-b84d-fef959cc07ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31234305-d4ea-48e2-b84d-fef959cc07ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd890fd83-fff6-440c-be42-2611e9d7d4e7', 'volume_name': 'volume-d890fd83-fff6-440c-be42-2611e9d7d4e7', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e334cdfc-41fb-4886-9ba7-0c0950e6320f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e334cdfc-41fb-4886-9ba7-0c0950e6320f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0c5c2f-127b-4e88-b89c-98aa350f5f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:58 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume d890fd83-fff6-440c-be42-2611e9d7d4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d890fd83-fff6-440c-be42-2611e9d7d4e7', 'volume_size': 1} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-150327029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d890fd83-fff6-440c-be42-2611e9d7d4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290998410794282a8e5bfa8c027f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:28:59Z,use_quota=True,user_id='d5f5d4b141a3415fab7ef2aa3f8e9327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Creating volume d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:28:58 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:28:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:58 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 1073741824 Feb 27 22:28:58 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:59 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37.5f3f1020-cac9-4491-8a84-60a9c38a76c7" returned: 0 in 0.441s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-quobyte-5f3f1020-cac9-4491-8a84-60a9c38a76c7" released by "_delete_snapshot" :: held 1.928s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-quobyte-2e53bc49-7f1a-4091-b777-0e837ac5bc37" released by "delete_snapshot" :: held 1.942s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Created reservations ['be3b4883-8fb0-4e4b-bb3e-8183a97be82e', 'b7163bba-8acf-4f7e-b47d-3dff782c9e56', 'dd47e155-fd23-43ff-9a30-9c513bcf1c4f', '85704f21-7a6f-404c-b897-7a2dac8c48d1'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:28:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Delete snapshot completed successfully. Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a1f7236d-ca06-4158-81ae-e50f73318bdf tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-5f3f1020-cac9-4491-8a84-60a9c38a76c7-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "cinder-2e53bc49-7f1a-4091-b777-0e837ac5bc37-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-2e53bc49-7f1a-4091-b777-0e837ac5bc37-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "cinder-quobyte-2e53bc49-7f1a-4091-b777-0e837ac5bc37" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-quobyte-2e53bc49-7f1a-4091-b777-0e837ac5bc37" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:28:59 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 1073741824" returned: 0 in 0.569s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53e796c-dd3b-4b8f-a351-6becba23c8aa]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:59 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 Feb 27 22:28:59 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:59 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 Feb 27 22:28:59 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:59 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7" returned: 0 in 0.439s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:28:59 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37" returned: 0 in 0.476s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0c5c2f-127b-4e88-b89c-98aa350f5f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d890fd83-fff6-440c-be42-2611e9d7d4e7', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:59 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37 Feb 27 22:28:59 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120e3918-0586-4e10-918e-92c198f536ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:28:59 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 (d890fd83-fff6-440c-be42-2611e9d7d4e7): created successfully Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120e3918-0586-4e10-918e-92c198f536ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:28:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (faef3192-51df-4a39-8453-35779dcbe7ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:28:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1e360e71-dde5-4c63-bd92-3a48bde2d3c2 tempest-VolumesSnapshotTestJSON-1575833507 None] Created volume successfully. Feb 27 22:29:00 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-2e53bc49-7f1a-4091-b777-0e837ac5bc37" returned: 0 in 0.407s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-quobyte-2e53bc49-7f1a-4091-b777-0e837ac5bc37" released by "delete_volume" :: held 0.926s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Created reservations ['0d96d712-304b-4392-ad57-e0efa562b609', 'd16ada30-6700-46db-8d9d-90e2c9bb8ba4', '5411e3e1-339e-43d7-be7e-cd39a0734270', 'eceeb7b1-8747-4f44-9747-1a18da5760c9'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:00 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:00 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:00 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.480s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Deleted volume successfully. Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-70eaf5d7-f94b-4121-b088-969369c6fd41 tempest-SnapshotMetadataTestJSON-718297455 None] Lock "cinder-2e53bc49-7f1a-4091-b777-0e837ac5bc37-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Creating offline snapshot 732878f8-a8cf-4b19-b813-3b0ee42a2d61 of volume d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4439ec89-cd49-4956-aa68-bc12f686496d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:01 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 Feb 27 22:29:01 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:01 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7" returned: 0 in 0.482s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:01 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 1G Feb 27 22:29:01 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:02 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 1G" returned: 0 in 0.533s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:02 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 Feb 27 22:29:02 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:02 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61" returned: 0 in 0.502s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:02 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 is being set with open permissions: ugo+rw Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:02 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 Feb 27 22:29:02 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Flow 'volume_create_manager' (af081ceb-264f-45af-9c15-bd59c7ef0b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7780de5e-6636-4c55-93f5-913b95935c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7780de5e-6636-4c55-93f5-913b95935c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2080776650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff4bdc9-09e2-4ffb-a225-c4ca180315a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d72c5d7e5e7485aaacadfa00dc4d66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:03Z,use_quota=True,user_id='7282318319354fd4ae4a0431df348a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e7b8d5-33f9-4a29-b48b-5c55f36bc68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e7b8d5-33f9-4a29-b48b-5c55f36bc68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d76cb3-6ca3-4623-9a93-a8eeaa0b4281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d76cb3-6ca3-4623-9a93-a8eeaa0b4281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff4bdc9-09e2-4ffb-a225-c4ca180315a2', 'volume_name': 'volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2', 'volume_size': 2}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a10a68c-6e8a-48b3-8f1a-3ae6dae0e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a10a68c-6e8a-48b3-8f1a-3ae6dae0e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca567c85-e582-426c-ba33-74ba277f3093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:02 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Volume 1ff4bdc9-09e2-4ffb-a225-c4ca180315a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2', 'volume_size': 2} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:02 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61" returned: 0 in 0.438s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:02 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.info Feb 27 22:29:02 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:03 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.info" returned: 0 in 0.418s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:03 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.info is being set with open permissions: ugo+rw Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:03 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.info Feb 27 22:29:03 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:03 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.info" returned: 0 in 0.419s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.996s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2080776650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff4bdc9-09e2-4ffb-a225-c4ca180315a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d72c5d7e5e7485aaacadfa00dc4d66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:03Z,use_quota=True,user_id='7282318319354fd4ae4a0431df348a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Creating volume 1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:03 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 2147483648 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:03 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=185,cinder:INSERT=74,cinder:UPDATE=206,cinder:DELETE=19 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:29:03 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 2147483648 Feb 27 22:29:03 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5c056660-8f20-41c2-8c7c-42c59c8d74b6 tempest-VolumesSnapshotTestJSON-1575833507 None] Create snapshot completed successfully Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:04 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (171517d1-1a33-4330-9096-1fd298bfcaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ca36ce-1771-4e11-9868-7bf0a30f781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ca36ce-1771-4e11-9868-7bf0a30f781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1154106353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202bef59-821a-4924-9f58-cd4554dc1c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0290998410794282a8e5bfa8c027f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=732878f8-a8cf-4b19-b813-3b0ee42a2d61,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:04Z,use_quota=True,user_id='d5f5d4b141a3415fab7ef2aa3f8e9327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bd892e-15dc-4d7b-978c-3ed3da8371be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bd892e-15dc-4d7b-978c-3ed3da8371be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d07cb8-dfac-40a9-b1e1-5f414555d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d07cb8-dfac-40a9-b1e1-5f414555d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '202bef59-821a-4924-9f58-cd4554dc1c84', 'volume_name': 'volume-202bef59-821a-4924-9f58-cd4554dc1c84', 'volume_size': 1, 'snapshot_id': '732878f8-a8cf-4b19-b813-3b0ee42a2d61'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409438cc-2dab-40fe-91ba-5ad5f85f36c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409438cc-2dab-40fe-91ba-5ad5f85f36c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ecf38e-c96b-4f29-984a-c7a58f526aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:04 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume 202bef59-821a-4924-9f58-cd4554dc1c84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-202bef59-821a-4924-9f58-cd4554dc1c84', 'volume_size': 1, 'snapshot_id': '732878f8-a8cf-4b19-b813-3b0ee42a2d61'} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 2147483648" returned: 0 in 0.613s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:04 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 Feb 27 22:29:04 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:04 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2" returned: 0 in 0.409s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.429s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-732878f8-a8cf-4b19-b813-3b0ee42a2d61-202bef59-821a-4924-9f58-cd4554dc1c84" by "_create_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca567c85-e582-426c-ba33-74ba277f3093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2', 'volume_size': 2}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06600b8-1388-44f2-aac1-ccdaf88ed799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-732878f8-a8cf-4b19-b813-3b0ee42a2d61-202bef59-821a-4924-9f58-cd4554dc1c84" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Creating volume 202bef59-821a-4924-9f58-cd4554dc1c84 from snapshot 732878f8-a8cf-4b19-b813-3b0ee42a2d61 {{(pid=83540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-202bef59-821a-4924-9f58-cd4554dc1c84" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:04 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Volume volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 (1ff4bdc9-09e2-4ffb-a225-c4ca180315a2): created successfully Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06600b8-1388-44f2-aac1-ccdaf88ed799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Flow 'volume_create_manager' (af081ceb-264f-45af-9c15-bd59c7ef0b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-202bef59-821a-4924-9f58-cd4554dc1c84" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] snapshot: 732878f8-a8cf-4b19-b813-3b0ee42a2d61, volume: 202bef59-821a-4924-9f58-cd4554dc1c84, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:29:04 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c13aa805-d975-48eb-a3ed-dbfb3d9329ba tempest-VolumesCloneNegativeTest-1694081399 None] Created volume successfully. Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[baae61ee-e083-4f3b-8503-1935dbbb166e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:05 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 Feb 27 22:29:05 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:05 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61" returned: 0 in 0.477s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d890fd83-fff6-440c-be42-2611e9d7d4e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4d1811-e982-4da6-8dbb-d3055e90def7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:05 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 Feb 27 22:29:05 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:05 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7" returned: 0 in 0.503s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:05 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 Feb 27 22:29:05 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Acquiring lock "cinder-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Lock "cinder-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Acquiring lock "cinder-quobyte-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Lock "cinder-quobyte-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2" acquired by "delete_volume" :: waited 0.006s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:06 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f88160-747a-473d-9f70-d1fa254a94b8]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:06 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 Feb 27 22:29:06 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:06 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2" returned: 0 in 0.578s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:06 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2 Feb 27 22:29:06 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:07 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2" returned: 0 in 1.318s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Lock "cinder-quobyte-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2" released by "delete_volume" :: held 1.920s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:07 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Created reservations ['c2654bff-43a5-4336-8e63-3c47208c7874', 'd59fa1b9-50f8-4994-8505-e63f3baf8cdc', '8e1283f5-5326-4e93-8ebe-d6b52b627070', '56fc391f-6b2a-4a11-b9da-659a84c8c4eb'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:08 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84" returned: 0 in 2.082s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc82f6ec-a431-4f0f-a46b-ba283940e208]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:08 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:08 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:08 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 Feb 27 22:29:08 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:08 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.506s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:08 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Deleted volume successfully. Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f5dacaa4-b26b-4035-9f88-b1a7c9486130 tempest-VolumesCloneNegativeTest-1694081399 None] Lock "cinder-1ff4bdc9-09e2-4ffb-a225-c4ca180315a2-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:08 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7" returned: 0 in 0.701s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:29:08 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Converted 1024.00 MB image at 491.51 MB/s Feb 27 22:29:08 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 is being set with open permissions: ugo+rw Feb 27 22:29:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:08 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 Feb 27 22:29:08 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:09 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84" returned: 0 in 0.487s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-202bef59-821a-4924-9f58-cd4554dc1c84" released by "_copy_volume_from_snapshot" :: held 4.315s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-732878f8-a8cf-4b19-b813-3b0ee42a2d61-202bef59-821a-4924-9f58-cd4554dc1c84" released by "_create_volume_from_snapshot" :: held 4.347s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.370s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ecf38e-c96b-4f29-984a-c7a58f526aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202bef59-821a-4924-9f58-cd4554dc1c84', 'volume_size': 1, 'snapshot_id': '732878f8-a8cf-4b19-b813-3b0ee42a2d61'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebd5437-4c3e-4457-917c-86597859995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:09 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Volume volume-202bef59-821a-4924-9f58-cd4554dc1c84 (202bef59-821a-4924-9f58-cd4554dc1c84): created successfully Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebd5437-4c3e-4457-917c-86597859995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Flow 'volume_create_manager' (171517d1-1a33-4330-9096-1fd298bfcaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:09 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-fb16ad02-ceba-4dba-9849-efda6a8a5b15 tempest-VolumesSnapshotTestJSON-1575833507 None] Created volume successfully. Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-202bef59-821a-4924-9f58-cd4554dc1c84-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-202bef59-821a-4924-9f58-cd4554dc1c84-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-202bef59-821a-4924-9f58-cd4554dc1c84" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-202bef59-821a-4924-9f58-cd4554dc1c84" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9708a7-c37b-48f3-a2be-ad054317297c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Flow 'volume_create_manager' (c686593b-248b-4f3b-aea9-8f9a310322de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bff085-2ae1-47ac-8ca5-2f316c1c2ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bff085-2ae1-47ac-8ca5-2f316c1c2ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-725794531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bfd789-9057-4d60-a208-46958969f071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fde1d332bc43099caa11c544f95f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:10Z,use_quota=True,user_id='90d2663ff8c24e3495ed88fbbeca65cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:10 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 Feb 27 22:29:10 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7bb604-6b25-45aa-9921-b3a9e2130ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7bb604-6b25-45aa-9921-b3a9e2130ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cab29ce-c4b0-4ba6-a556-af15385416cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cab29ce-c4b0-4ba6-a556-af15385416cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70bfd789-9057-4d60-a208-46958969f071', 'volume_name': 'volume-70bfd789-9057-4d60-a208-46958969f071', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488311e8-2933-4dce-89ab-7bc994270c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488311e8-2933-4dce-89ab-7bc994270c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a09bb40-0f35-4b27-a255-996b4bf648d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:10 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Volume 70bfd789-9057-4d60-a208-46958969f071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70bfd789-9057-4d60-a208-46958969f071', 'volume_size': 1} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-725794531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bfd789-9057-4d60-a208-46958969f071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fde1d332bc43099caa11c544f95f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:10Z,use_quota=True,user_id='90d2663ff8c24e3495ed88fbbeca65cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Creating volume 70bfd789-9057-4d60-a208-46958969f071 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:10 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:10 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 1073741824 Feb 27 22:29:10 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:10 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84" returned: 0 in 0.494s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:10 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84 Feb 27 22:29:10 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:10 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 1073741824" returned: 0 in 0.492s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:10 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 Feb 27 22:29:10 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:10 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-202bef59-821a-4924-9f58-cd4554dc1c84" returned: 0 in 0.453s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-202bef59-821a-4924-9f58-cd4554dc1c84" released by "delete_volume" :: held 0.987s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:10 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Created reservations ['e681ae28-8cde-4402-8391-19d315ddb9df', 'c80f0bba-d916-4f59-b599-6bdc4cefd6ab', '3cd84500-b4bf-473a-8274-ad0c3a393482', '4482b37b-6d37-44ac-97cc-9ae9548fba19'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:11 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:11 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:11 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071" returned: 0 in 0.454s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a09bb40-0f35-4b27-a255-996b4bf648d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70bfd789-9057-4d60-a208-46958969f071', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe77d85-f9b4-423e-812e-018ec59c6dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-732878f8-a8cf-4b19-b813-3b0ee42a2d61-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:11 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Volume volume-70bfd789-9057-4d60-a208-46958969f071 (70bfd789-9057-4d60-a208-46958969f071): created successfully Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe77d85-f9b4-423e-812e-018ec59c6dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Flow 'volume_create_manager' (c686593b-248b-4f3b-aea9-8f9a310322de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8fb553fd-f099-4aa5-9c19-189e8adda46c tempest-VolumesNegativeTest-70108598 None] Created volume successfully. Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-732878f8-a8cf-4b19-b813-3b0ee42a2d61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-d890fd83-fff6-440c-be42-2611e9d7d4e7" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-d890fd83-fff6-440c-be42-2611e9d7d4e7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-732878f8-a8cf-4b19-b813-3b0ee42a2d61" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-732878f8-a8cf-4b19-b813-3b0ee42a2d61" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Deleting offline snapshot 732878f8-a8cf-4b19-b813-3b0ee42a2d61 of volume d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] snapshot_file for this snap is: volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16c4160-b379-49ee-8300-e6dd0ec24523]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:11 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 Feb 27 22:29:11 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:11 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.454s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Deleted volume successfully. Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2489a122-7911-4956-8379-4bea61555f44 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-202bef59-821a-4924-9f58-cd4554dc1c84-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:11 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61" returned: 0 in 0.487s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d890fd83-fff6-440c-be42-2611e9d7d4e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ba8b9b-4b28-4447-ae29-8231e0fe2fa2]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:11 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 Feb 27 22:29:11 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:12 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7" returned: 0 in 0.540s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:12 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 Feb 27 22:29:12 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:12 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61" returned: 0 in 0.526s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:12 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61 Feb 27 22:29:12 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:13 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7.732878f8-a8cf-4b19-b813-3b0ee42a2d61" returned: 0 in 0.447s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-732878f8-a8cf-4b19-b813-3b0ee42a2d61" released by "_delete_snapshot" :: held 2.054s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-d890fd83-fff6-440c-be42-2611e9d7d4e7" released by "delete_snapshot" :: held 2.066s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:13 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Created reservations ['cacf9de3-88fe-411c-8a21-b8283c8ac46f', '183e1078-d605-4f6e-815e-f46524db47dc', '8dee259f-67fb-472e-85d2-dfacff88d375', '1c769c81-58ca-4d69-bf7f-b93e82d157e7'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:13 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Delete snapshot completed successfully. Feb 27 22:29:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-737143c9-86e5-4542-9e89-79e80695481e tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-732878f8-a8cf-4b19-b813-3b0ee42a2d61-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-d890fd83-fff6-440c-be42-2611e9d7d4e7-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-d890fd83-fff6-440c-be42-2611e9d7d4e7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-d890fd83-fff6-440c-be42-2611e9d7d4e7" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-d890fd83-fff6-440c-be42-2611e9d7d4e7" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:14 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfb59e6-c166-450a-8a63-9d5943d7056d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:14 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 Feb 27 22:29:14 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:14 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7" returned: 0 in 0.467s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:14 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7 Feb 27 22:29:14 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:15 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d890fd83-fff6-440c-be42-2611e9d7d4e7" returned: 0 in 0.434s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-d890fd83-fff6-440c-be42-2611e9d7d4e7" released by "delete_volume" :: held 0.932s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Created reservations ['2739ae73-c87a-47cc-be29-78987eec86a7', 'a3fd56d5-3565-4128-afcd-55fa9bcac927', '30168bda-bdc1-48ab-ab2a-b2d4063ef794', 'e40c4ebe-0cee-400b-aab5-6d9f22566be2'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:15 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:15 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-1f491cf1-9f2c-4950-8eb6-8b201b72f53d-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-1f491cf1-9f2c-4950-8eb6-8b201b72f53d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "cinder-quobyte-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0007c9e6-0d8b-43bc-bccc-1dc38ab1298d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:15 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d Feb 27 22:29:15 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:15 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.434s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:15 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Deleted volume successfully. Feb 27 22:29:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-550933ac-ee71-4300-80df-7ec0eb82f3a8 tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-d890fd83-fff6-440c-be42-2611e9d7d4e7-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:16 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" returned: 0 in 0.481s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:16 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d Feb 27 22:29:16 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:16 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" returned: 0 in 0.394s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-quobyte-1f491cf1-9f2c-4950-8eb6-8b201b72f53d" released by "delete_volume" :: held 0.921s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Created reservations ['3ad788b2-de17-43f2-bda6-b879135f8ba9', '4578435e-8572-445e-ab3d-f960d2138127', '2d08d238-2b4f-4da4-a671-1d87fa881423', '5bf38efc-58ba-43b9-8d3c-077e78d22516'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:16 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:16 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:17 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.507s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:17 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:17 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Deleted volume successfully. Feb 27 22:29:17 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a4a8d2c1-0b01-4022-9314-9c3699bdd7eb tempest-VolumesSnapshotTestJSON-1575833507 None] Lock "cinder-1f491cf1-9f2c-4950-8eb6-8b201b72f53d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (09210a23-aa5f-4755-a1cf-c4bad1127889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba7e2c9-89b0-4ab8-81da-d58ccd2fbcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba7e2c9-89b0-4ab8-81da-d58ccd2fbcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029512803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2746e0-e23f-4e63-aec9-e3fe80feb657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:21Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c8adc9-552b-4399-aa80-f05e9eb3a965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c8adc9-552b-4399-aa80-f05e9eb3a965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fd349b-5706-4bc7-ba37-e3571ba75760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fd349b-5706-4bc7-ba37-e3571ba75760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2746e0-e23f-4e63-aec9-e3fe80feb657', 'volume_name': 'volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ead0d2-2592-4f79-9e59-be833eb764fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ead0d2-2592-4f79-9e59-be833eb764fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60116ec2-ba73-4552-9893-e634e5a1c730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:20 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume fd2746e0-e23f-4e63-aec9-e3fe80feb657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657', 'volume_size': 1} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029512803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2746e0-e23f-4e63-aec9-e3fe80feb657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:21Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Creating volume fd2746e0-e23f-4e63-aec9-e3fe80feb657 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:20 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:20 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 1073741824 Feb 27 22:29:20 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:21 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 1073741824" returned: 0 in 0.532s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:21 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 Feb 27 22:29:21 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:21 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657" returned: 0 in 0.464s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60116ec2-ba73-4552-9893-e634e5a1c730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbad4e32-5394-4483-8731-92dc927f002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:21 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 (fd2746e0-e23f-4e63-aec9-e3fe80feb657): created successfully Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbad4e32-5394-4483-8731-92dc927f002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (09210a23-aa5f-4755-a1cf-c4bad1127889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:21 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-40f083a5-02f1-4140-9fb0-42b9490e1ca9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created volume successfully. Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (d23bd567-995a-4b36-88f1-b6ee0a85f417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99bd424-e0a4-4ef1-8a62-ea4c8248920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99bd424-e0a4-4ef1-8a62-ea4c8248920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138749973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3422cb-198e-4da2-9897-0dcacc2ed789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:23Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43de7ff-5f45-47fb-9924-f8ab98d55e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43de7ff-5f45-47fb-9924-f8ab98d55e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37163fe-5a9e-4957-82b7-cd238c0ed18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37163fe-5a9e-4957-82b7-cd238c0ed18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3422cb-198e-4da2-9897-0dcacc2ed789', 'volume_name': 'volume-df3422cb-198e-4da2-9897-0dcacc2ed789', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039a2c62-128a-4a50-a08c-6b8511e8696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039a2c62-128a-4a50-a08c-6b8511e8696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601f0b62-56ba-4170-933d-6f8a2ffd3a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume df3422cb-198e-4da2-9897-0dcacc2ed789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3422cb-198e-4da2-9897-0dcacc2ed789', 'volume_size': 1} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138749973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3422cb-198e-4da2-9897-0dcacc2ed789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:23Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Creating volume df3422cb-198e-4da2-9897-0dcacc2ed789 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:23 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:23 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 1073741824 Feb 27 22:29:23 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (5f364697-5625-48aa-b3e9-f2b0a822fe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e18b9b9-d84d-46df-8461-866ba1d407d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e18b9b9-d84d-46df-8461-866ba1d407d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128757175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9438cff-36d3-4765-88e9-bb3519d072fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:23Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6507316-0ac5-412f-ac01-0de2f4ae9433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6507316-0ac5-412f-ac01-0de2f4ae9433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbadd438-4dc0-4edd-9088-b4e8e0d4104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbadd438-4dc0-4edd-9088-b4e8e0d4104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9438cff-36d3-4765-88e9-bb3519d072fa', 'volume_name': 'volume-f9438cff-36d3-4765-88e9-bb3519d072fa', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ae494a-2e13-4b05-85df-618273fd2c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ae494a-2e13-4b05-85df-618273fd2c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb07d09-f227-4cfc-9091-4fa36e12dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume f9438cff-36d3-4765-88e9-bb3519d072fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9438cff-36d3-4765-88e9-bb3519d072fa', 'volume_size': 1} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (825d890f-f6aa-47d5-8a4d-2d91b8fc7c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7caa6600-de5e-487c-a22b-89d3735485f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7caa6600-de5e-487c-a22b-89d3735485f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1118822044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881758f0-5285-48c0-a9a8-9c9abacc17b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:24Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139a6ef1-6e6a-4474-a4af-a60bd126a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139a6ef1-6e6a-4474-a4af-a60bd126a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a49fb29-2ad5-48ad-b22d-d4ac6be2b46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a49fb29-2ad5-48ad-b22d-d4ac6be2b46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881758f0-5285-48c0-a9a8-9c9abacc17b7', 'volume_name': 'volume-881758f0-5285-48c0-a9a8-9c9abacc17b7', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38630751-fd15-4ef4-9cb3-6869d26dbbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38630751-fd15-4ef4-9cb3-6869d26dbbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3839c3-71b4-4251-825c-0798aa3b1c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume 881758f0-5285-48c0-a9a8-9c9abacc17b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881758f0-5285-48c0-a9a8-9c9abacc17b7', 'volume_size': 1} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (9b6a57ac-4a36-4d4a-835f-0ff64a24feef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa2cf99-3ffd-476f-b046-ebc25923d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa2cf99-3ffd-476f-b046-ebc25923d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699202024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7c8820-cdd5-41cb-9bee-f0c9a74629a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:24Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe21bda-d760-4fca-b4fd-ace2ca1e88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe21bda-d760-4fca-b4fd-ace2ca1e88a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d0a67b-cc4e-428f-822d-db72b6ba850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d0a67b-cc4e-428f-822d-db72b6ba850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7c8820-cdd5-41cb-9bee-f0c9a74629a1', 'volume_name': 'volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de045a82-5474-4394-ae6e-0d5e24e471ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de045a82-5474-4394-ae6e-0d5e24e471ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4687907-4bc3-40e9-8afc-07f7fd3d5281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:24 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume 8c7c8820-cdd5-41cb-9bee-f0c9a74629a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1', 'volume_size': 1} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:24 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 1073741824" returned: 0 in 0.870s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:24 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 Feb 27 22:29:24 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (5f9d3863-f548-4da7-9974-0ac2b5d1905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287db458-0e69-443a-b759-c12f4d6b91fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287db458-0e69-443a-b759-c12f4d6b91fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259780439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94945e54-402b-4820-8f97-269a6543d798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:24Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e1736-1877-46da-a9da-89e5ca4370ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e1736-1877-46da-a9da-89e5ca4370ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e06f95c-ed5f-407a-bfd8-faa5ba276c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e06f95c-ed5f-407a-bfd8-faa5ba276c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94945e54-402b-4820-8f97-269a6543d798', 'volume_name': 'volume-94945e54-402b-4820-8f97-269a6543d798', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f5b5f1-d45f-4032-9edb-74bd7674dd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f5b5f1-d45f-4032-9edb-74bd7674dd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a18f5f-b104-47ce-8c25-0cd0d9186dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:24 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume 94945e54-402b-4820-8f97-269a6543d798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94945e54-402b-4820-8f97-269a6543d798', 'volume_size': 1} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:24 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789" returned: 0 in 0.621s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128757175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9438cff-36d3-4765-88e9-bb3519d072fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:23Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Creating volume f9438cff-36d3-4765-88e9-bb3519d072fa {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:24 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601f0b62-56ba-4170-933d-6f8a2ffd3a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3422cb-198e-4da2-9897-0dcacc2ed789', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c73d9b-95e6-4d28-a954-0a8e71b3d679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:24 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa 1073741824 Feb 27 22:29:24 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:24 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume volume-df3422cb-198e-4da2-9897-0dcacc2ed789 (df3422cb-198e-4da2-9897-0dcacc2ed789): created successfully Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c73d9b-95e6-4d28-a954-0a8e71b3d679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (d23bd567-995a-4b36-88f1-b6ee0a85f417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:24 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-ecd5bdc7-6d74-42b3-9ae7-fc976a407bfd tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created volume successfully. Feb 27 22:29:25 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa 1073741824" returned: 0 in 0.582s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:25 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa Feb 27 22:29:25 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:25 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa" returned: 0 in 0.483s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.075s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1118822044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881758f0-5285-48c0-a9a8-9c9abacc17b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:24Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Creating volume 881758f0-5285-48c0-a9a8-9c9abacc17b7 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:25 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb07d09-f227-4cfc-9091-4fa36e12dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9438cff-36d3-4765-88e9-bb3519d072fa', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be4d124-3749-4375-89a8-153c6db7cfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:25 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 1073741824 Feb 27 22:29:25 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:25 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume volume-f9438cff-36d3-4765-88e9-bb3519d072fa (f9438cff-36d3-4765-88e9-bb3519d072fa): created successfully Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be4d124-3749-4375-89a8-153c6db7cfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (5f364697-5625-48aa-b3e9-f2b0a822fe9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:25 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0d5303b5-34a0-49b8-9be1-2a4eff7dcd6c tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created volume successfully. Feb 27 22:29:26 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 1073741824" returned: 0 in 0.541s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:26 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 Feb 27 22:29:26 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:26 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7" returned: 0 in 0.423s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.902s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699202024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7c8820-cdd5-41cb-9bee-f0c9a74629a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:24Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Creating volume 8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:26 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3839c3-71b4-4251-825c-0798aa3b1c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881758f0-5285-48c0-a9a8-9c9abacc17b7', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7c92b8-e404-4363-9b23-01c02cfb6313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:26 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 1073741824 Feb 27 22:29:26 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:26 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 (881758f0-5285-48c0-a9a8-9c9abacc17b7): created successfully Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7c92b8-e404-4363-9b23-01c02cfb6313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (825d890f-f6aa-47d5-8a4d-2d91b8fc7c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:26 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0276c3e5-daf9-4792-ab1a-0c95195557e9 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created volume successfully. Feb 27 22:29:27 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 1073741824" returned: 0 in 0.596s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:27 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 Feb 27 22:29:27 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:27 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1" returned: 0 in 0.416s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.522s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259780439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94945e54-402b-4820-8f97-269a6543d798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aff131f64a4ea7a9344ec9447e6039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:24Z,use_quota=True,user_id='5623cff015ce43d28624c3ac27b58cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Creating volume 94945e54-402b-4820-8f97-269a6543d798 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:27 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4687907-4bc3-40e9-8afc-07f7fd3d5281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7fce2d-b9e0-490f-bd2f-a429eca3ebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:27 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 1073741824 Feb 27 22:29:27 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:27 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 (8c7c8820-cdd5-41cb-9bee-f0c9a74629a1): created successfully Feb 27 22:29:27 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7fce2d-b9e0-490f-bd2f-a429eca3ebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:28 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (9b6a57ac-4a36-4d4a-835f-0ff64a24feef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:28 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-adbf1695-02c6-4a10-afb6-99db276e44ac tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created volume successfully. Feb 27 22:29:28 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 1073741824" returned: 0 in 0.602s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:28 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 Feb 27 22:29:28 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:29 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798" returned: 0 in 0.434s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a18f5f-b104-47ce-8c25-0cd0d9186dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94945e54-402b-4820-8f97-269a6543d798', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074ec3d2-4e4a-4d89-9f7f-b3cbde4ecdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:29 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Volume volume-94945e54-402b-4820-8f97-269a6543d798 (94945e54-402b-4820-8f97-269a6543d798): created successfully Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074ec3d2-4e4a-4d89-9f7f-b3cbde4ecdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Flow 'volume_create_manager' (5f9d3863-f548-4da7-9974-0ac2b5d1905a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-77176ebc-3e5e-408c-b8bd-ac20d13b6008 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created volume successfully. Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-94945e54-402b-4820-8f97-269a6543d798-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-94945e54-402b-4820-8f97-269a6543d798-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-quobyte-94945e54-402b-4820-8f97-269a6543d798" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-94945e54-402b-4820-8f97-269a6543d798" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0c9f60-92b3-49df-a2f7-aece9c6cadca]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:29 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 Feb 27 22:29:29 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:30 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798" returned: 0 in 0.469s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:30 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798 Feb 27 22:29:30 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:30 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-94945e54-402b-4820-8f97-269a6543d798" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-94945e54-402b-4820-8f97-269a6543d798" released by "delete_volume" :: held 0.947s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created reservations ['0d3eb965-cbdc-4c77-b481-3b61a9631f97', 'e5488924-e197-4a34-aefe-19aa1d0fdc7a', 'b58724a9-3d35-435b-bb39-0f9a6df5e7e0', '29ff454b-08cb-464a-9114-74583d849c59'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:30 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:30 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-quobyte-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29941ad-1afa-4d0a-bb94-daea511d6f60]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:31 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 Feb 27 22:29:31 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:31 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.434s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:31 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Deleted volume successfully. Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3173e4d1-268e-49c8-96fd-0a5bebcf5c85 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-94945e54-402b-4820-8f97-269a6543d798-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:31 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:31 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1 Feb 27 22:29:31 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:31 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1" returned: 0 in 0.420s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1" released by "delete_volume" :: held 0.967s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created reservations ['8664fa2c-7998-46a6-9e11-afd13ba775ec', '74930bae-988a-4796-a475-5056ca6497d7', '99b7cc1b-57c4-4690-89da-ae44124e24ef', '74720aaa-ba53-44b2-b830-8b0561dcec2a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-881758f0-5285-48c0-a9a8-9c9abacc17b7-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:32 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:32 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-881758f0-5285-48c0-a9a8-9c9abacc17b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-quobyte-881758f0-5285-48c0-a9a8-9c9abacc17b7" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-881758f0-5285-48c0-a9a8-9c9abacc17b7" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb1f49-8971-451b-88e9-6049e674ff99]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:32 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 Feb 27 22:29:32 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:32 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.480s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:32 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Deleted volume successfully. Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7e8b5061-75cb-4428-893e-4408c5db83fe tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-8c7c8820-cdd5-41cb-9bee-f0c9a74629a1-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:32 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7" returned: 0 in 0.559s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:32 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7 Feb 27 22:29:32 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:33 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-881758f0-5285-48c0-a9a8-9c9abacc17b7" returned: 0 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-881758f0-5285-48c0-a9a8-9c9abacc17b7" released by "delete_volume" :: held 1.090s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=138,cinder:INSERT=39,cinder:UPDATE=174,cinder:DELETE=11 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created reservations ['c5651252-c491-476a-8e11-74ed27425a81', '6364da5d-5962-45b8-a2cf-3a4299bea407', 'b8cd86dc-6ae2-4dc1-a382-eb66eed4dfd3', '0c47b66c-86ad-471a-ab33-3f5abdc33653'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:33 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:33 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:33 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.442s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Deleted volume successfully. Feb 27 22:29:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-154d0c86-108f-4c04-a256-5e104675dab5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-881758f0-5285-48c0-a9a8-9c9abacc17b7-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-f9438cff-36d3-4765-88e9-bb3519d072fa-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-f9438cff-36d3-4765-88e9-bb3519d072fa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-quobyte-f9438cff-36d3-4765-88e9-bb3519d072fa" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-f9438cff-36d3-4765-88e9-bb3519d072fa" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:34 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c7c4b5-8985-4087-9acc-86c75352e679]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:34 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa Feb 27 22:29:34 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:34 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa" returned: 0 in 0.545s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:34 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa Feb 27 22:29:34 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:35 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-f9438cff-36d3-4765-88e9-bb3519d072fa" returned: 0 in 0.475s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-f9438cff-36d3-4765-88e9-bb3519d072fa" released by "delete_volume" :: held 1.061s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created reservations ['b239285d-0c30-48d1-a8ce-ed917239b0f4', '7ed04f73-4d4f-4bba-a2d5-84ab77986ce2', 'bf1aba55-3294-4b45-9c98-22e299ebedbf', 'b3683f1e-00e6-4f0d-915e-e206e599fab2'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:35 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:35 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:35 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.454s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:35 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Deleted volume successfully. Feb 27 22:29:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d193d759-92ec-464c-9d07-d3a6a85b9112 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-f9438cff-36d3-4765-88e9-bb3519d072fa-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Acquiring lock "cinder-70bfd789-9057-4d60-a208-46958969f071-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Lock "cinder-70bfd789-9057-4d60-a208-46958969f071-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Acquiring lock "cinder-quobyte-70bfd789-9057-4d60-a208-46958969f071" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Lock "cinder-quobyte-70bfd789-9057-4d60-a208-46958969f071" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d1c66b-e6e3-48b9-acae-9a5b8c08cd73]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:36 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 Feb 27 22:29:36 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-df3422cb-198e-4da2-9897-0dcacc2ed789-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-df3422cb-198e-4da2-9897-0dcacc2ed789-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-quobyte-df3422cb-198e-4da2-9897-0dcacc2ed789" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-df3422cb-198e-4da2-9897-0dcacc2ed789" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f3fe9-3db2-436f-8a40-65b7bf92bab8]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:36 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 Feb 27 22:29:36 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:36 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:36 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071" returned: 0 in 0.497s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:36 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:37 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789" returned: 0 in 0.500s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:37 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789 Feb 27 22:29:37 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:37 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-70bfd789-9057-4d60-a208-46958969f071" returned: 0 in 0.462s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Lock "cinder-quobyte-70bfd789-9057-4d60-a208-46958969f071" released by "delete_volume" :: held 0.981s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Created reservations ['3c53dc7d-6c89-444c-9ad7-9a282d521424', '9e832a25-2774-44e1-a024-56a7430ca2ea', '7b3c4904-79ae-44e1-bf77-e220e76a73cc', 'e5b7c566-1957-433d-80f8-7f49afa23c03'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:37 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:37 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:37 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df3422cb-198e-4da2-9897-0dcacc2ed789" returned: 0 in 0.433s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-df3422cb-198e-4da2-9897-0dcacc2ed789" released by "delete_volume" :: held 0.960s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created reservations ['e62306c2-8d7c-4c4c-a5a2-f1664aba2a48', '24a9e596-e5d7-46b8-be05-5b4f0d92011e', 'be804c4c-592b-40f3-b516-ad00ad4d6de0', '987507fd-4020-40af-818e-5562b8a5b36d'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:37 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:37 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-fd2746e0-e23f-4e63-aec9-e3fe80feb657-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-fd2746e0-e23f-4e63-aec9-e3fe80feb657-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "cinder-quobyte-fd2746e0-e23f-4e63-aec9-e3fe80feb657" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-fd2746e0-e23f-4e63-aec9-e3fe80feb657" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3da93ef-1d4d-4f22-bc92-30d5b9ab12af]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:37 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 Feb 27 22:29:37 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:37 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.466s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:37 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Deleted volume successfully. Feb 27 22:29:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-90a5d41b-6fd0-475a-b636-62984c0ce01f tempest-VolumesNegativeTest-70108598 None] Lock "cinder-70bfd789-9057-4d60-a208-46958969f071-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:38 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.503s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:38 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Deleted volume successfully. Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-23ab8373-aa8a-4f3d-8d26-89c5d300b2f5 tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-df3422cb-198e-4da2-9897-0dcacc2ed789-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:38 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657" returned: 0 in 0.547s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:38 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657 Feb 27 22:29:38 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:38 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-fd2746e0-e23f-4e63-aec9-e3fe80feb657" returned: 0 in 0.485s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-quobyte-fd2746e0-e23f-4e63-aec9-e3fe80feb657" released by "delete_volume" :: held 1.060s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Created reservations ['d024beb6-0f62-4e7c-b6fa-cf66c42a2230', '9d9d3938-a60d-4e32-9b42-1bc7683ebeda', '63a73ba6-4945-47d5-be59-6f4c858c9086', 'fad6e09b-4bbc-4a32-b351-84576cd43a60'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:38 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:38 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Flow 'volume_create_manager' (5a0afcaf-5ee7-4fe9-9cd6-d91661ebc360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00295094-1b75-4b8c-a990-feb8fce2cba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00295094-1b75-4b8c-a990-feb8fce2cba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1380024601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71654ead-42fc-45f0-8aa2-67200e00d162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d3b52e583804883b616c677cb8ff90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:39Z,use_quota=True,user_id='e39c3b1ae0cb45178a4e6d9e4bc03bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8033f44-89a9-4595-90ee-48b4355b89a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8033f44-89a9-4595-90ee-48b4355b89a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a41f920-ba24-40b0-a4d3-d2c4ed69ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a41f920-ba24-40b0-a4d3-d2c4ed69ee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71654ead-42fc-45f0-8aa2-67200e00d162', 'volume_name': 'volume-71654ead-42fc-45f0-8aa2-67200e00d162', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d3475b-ecaf-41b9-a29a-bdc10eab5fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d3475b-ecaf-41b9-a29a-bdc10eab5fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70011a63-3a30-418c-9d09-45ed62e84b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:39 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Volume 71654ead-42fc-45f0-8aa2-67200e00d162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71654ead-42fc-45f0-8aa2-67200e00d162', 'volume_size': 1} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1380024601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71654ead-42fc-45f0-8aa2-67200e00d162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d3b52e583804883b616c677cb8ff90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:39Z,use_quota=True,user_id='e39c3b1ae0cb45178a4e6d9e4bc03bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Creating volume 71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:39 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:39 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 1073741824 Feb 27 22:29:39 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:39 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.442s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:39 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Deleted volume successfully. Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af198ffe-5cf9-4508-ac2a-83658770c83b tempest-CreateVolumesFromSourceVolumeTest-587052041 None] Lock "cinder-fd2746e0-e23f-4e63-aec9-e3fe80feb657-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:39 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 1073741824" returned: 0 in 0.465s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:39 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 Feb 27 22:29:39 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:40 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162" returned: 0 in 0.471s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70011a63-3a30-418c-9d09-45ed62e84b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71654ead-42fc-45f0-8aa2-67200e00d162', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a54a652-cf4c-4836-9b2f-8159df78d4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:40 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Volume volume-71654ead-42fc-45f0-8aa2-67200e00d162 (71654ead-42fc-45f0-8aa2-67200e00d162): created successfully Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a54a652-cf4c-4836-9b2f-8159df78d4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Flow 'volume_create_manager' (5a0afcaf-5ee7-4fe9-9cd6-d91661ebc360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:40 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e7f6ee87-f51c-4f30-915f-ca6b2da6db9c tempest-VolumesSnapshotListTestJSON-1483667013 None] Created volume successfully. Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:40 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:40 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Creating offline snapshot e279be6d-ec47-46ff-b862-a4d576b3307f of volume 71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d626f297-92a5-48f0-b345-5301d3b9e0b1]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:41 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.457s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:29:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:29:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:29:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:29:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:29:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:29:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:29:41 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 Feb 27 22:29:41 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:41 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162" returned: 0 in 0.561s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:41 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f 1G Feb 27 22:29:41 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:42 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f 1G" returned: 0 in 0.514s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:42 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f Feb 27 22:29:42 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:42 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f" returned: 0 in 0.449s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:42 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f is being set with open permissions: ugo+rw Feb 27 22:29:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:42 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f Feb 27 22:29:42 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:43 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f" returned: 0 in 0.410s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:43 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.info Feb 27 22:29:43 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:43 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.info" returned: 0 in 0.404s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:43 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.info is being set with open permissions: ugo+rw Feb 27 22:29:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:43 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.info Feb 27 22:29:43 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:44 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.info" returned: 0 in 0.414s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.815s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7447bebe-bcb9-4055-a8da-92fc76aa3e86 tempest-VolumesSnapshotListTestJSON-1483667013 None] Create snapshot completed successfully Feb 27 22:29:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Creating offline snapshot 54752bb5-5af5-4672-bd1f-1760f4960614 of volume 71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:29:44 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d69108a-a49a-4ae2-a7ac-d80afc17a563]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:44 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f Feb 27 22:29:44 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:45 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f" returned: 0 in 0.512s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71654ead-42fc-45f0-8aa2-67200e00d162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:45 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 1G Feb 27 22:29:45 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:45 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 1G" returned: 0 in 0.500s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:45 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 Feb 27 22:29:45 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:46 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614" returned: 0 in 0.436s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:46 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 is being set with open permissions: ugo+rw Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:46 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 Feb 27 22:29:46 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:46 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614" returned: 0 in 0.406s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-168e48e4-02b1-4985-a372-40da7e9296b4 tempest-VolumesSnapshotListTestJSON-1483667013 None] Create snapshot completed successfully Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Creating offline snapshot ee1d5b46-b3a9-4338-9232-784865ee3fdd of volume 71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3a67cf-004f-4f3e-9113-eebc8ad6e8d3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:46 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 Feb 27 22:29:46 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:47 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614" returned: 0 in 0.522s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71654ead-42fc-45f0-8aa2-67200e00d162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:47 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd 1G Feb 27 22:29:47 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:47 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd 1G" returned: 0 in 0.522s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:47 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd Feb 27 22:29:47 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:48 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd" returned: 0 in 0.425s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:48 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd is being set with open permissions: ugo+rw Feb 27 22:29:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:48 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd Feb 27 22:29:48 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:48 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd" returned: 0 in 0.401s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:48 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-71c361ba-c945-4961-88e2-35374cd13a69 tempest-VolumesSnapshotListTestJSON-1483667013 None] Create snapshot completed successfully Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-ee1d5b46-b3a9-4338-9232-784865ee3fdd-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-ee1d5b46-b3a9-4338-9232-784865ee3fdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-quobyte-ee1d5b46-b3a9-4338-9232-784865ee3fdd" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-ee1d5b46-b3a9-4338-9232-784865ee3fdd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Deleting offline snapshot ee1d5b46-b3a9-4338-9232-784865ee3fdd of volume 71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] snapshot_file for this snap is: volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[69547c97-eb4a-4396-9621-4cb22a7a166e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:49 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd Feb 27 22:29:49 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:50 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd" returned: 0 in 0.516s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71654ead-42fc-45f0-8aa2-67200e00d162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:50 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a410326-95e0-41ed-ad13-f4c31319b76f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:50 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 Feb 27 22:29:50 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:50 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614" returned: 0 in 0.492s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71654ead-42fc-45f0-8aa2-67200e00d162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:50 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd Feb 27 22:29:50 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:51 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd" returned: 0 in 0.489s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:51 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd Feb 27 22:29:51 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:51 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.ee1d5b46-b3a9-4338-9232-784865ee3fdd" returned: 0 in 0.393s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-ee1d5b46-b3a9-4338-9232-784865ee3fdd" released by "_delete_snapshot" :: held 1.945s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" released by "delete_snapshot" :: held 1.963s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Created reservations ['07ea0607-2919-4836-9749-21dd7b5233c0', '0360535d-00ac-41f9-aba4-1d3c14a5d8e4', '6e3de6cd-8f6a-497f-ba3e-5ecbbbb7cc71', 'eff8ea2b-e980-4c36-a0ed-e7c971fd01ca'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:51 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Delete snapshot completed successfully. Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-06be2bfc-5d20-426a-8c36-8f9dcc2e0f37 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-ee1d5b46-b3a9-4338-9232-784865ee3fdd-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-54752bb5-5af5-4672-bd1f-1760f4960614-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-54752bb5-5af5-4672-bd1f-1760f4960614-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-quobyte-54752bb5-5af5-4672-bd1f-1760f4960614" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-54752bb5-5af5-4672-bd1f-1760f4960614" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Deleting offline snapshot 54752bb5-5af5-4672-bd1f-1760f4960614 of volume 71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] snapshot_file for this snap is: volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c51347-304a-404c-8406-a09928e5a407]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:51 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 Feb 27 22:29:51 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:52 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614" returned: 0 in 0.470s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71654ead-42fc-45f0-8aa2-67200e00d162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:52 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b3618a-3f8e-43b7-8489-79c7a9bd3487]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:52 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f Feb 27 22:29:52 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:52 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f" returned: 0 in 0.484s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71654ead-42fc-45f0-8aa2-67200e00d162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:52 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 Feb 27 22:29:52 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:53 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614" returned: 0 in 0.481s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:53 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614 Feb 27 22:29:53 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:53 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.54752bb5-5af5-4672-bd1f-1760f4960614" returned: 0 in 0.433s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-54752bb5-5af5-4672-bd1f-1760f4960614" released by "_delete_snapshot" :: held 1.923s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" released by "delete_snapshot" :: held 1.936s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Created reservations ['08d2b920-0c3b-4831-9457-f9e1365657be', '6abfa2fe-a3ae-41c6-80a2-d0f977a36f9c', 'a89c741d-7ae2-4048-934c-3cfab4617b78', '5783a373-d7a1-43b1-b89f-9f972445cd53'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:53 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Delete snapshot completed successfully. Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66347539-e14a-4608-9046-5a234fdad220 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-54752bb5-5af5-4672-bd1f-1760f4960614-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-e279be6d-ec47-46ff-b862-a4d576b3307f-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-e279be6d-ec47-46ff-b862-a4d576b3307f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-quobyte-e279be6d-ec47-46ff-b862-a4d576b3307f" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-e279be6d-ec47-46ff-b862-a4d576b3307f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Deleting offline snapshot e279be6d-ec47-46ff-b862-a4d576b3307f of volume 71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] snapshot_file for this snap is: volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a552fa-3a9d-4569-9601-8518bd69f9a3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:53 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f Feb 27 22:29:53 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:54 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f" returned: 0 in 0.512s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71654ead-42fc-45f0-8aa2-67200e00d162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:29:54 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c9f355-e383-48e8-b477-cb3ae595c3bb]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:54 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 Feb 27 22:29:54 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:54 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162" returned: 0 in 0.484s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:54 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f Feb 27 22:29:54 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:55 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f" returned: 0 in 0.484s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:55 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f Feb 27 22:29:55 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:55 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162.e279be6d-ec47-46ff-b862-a4d576b3307f" returned: 0 in 0.418s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-e279be6d-ec47-46ff-b862-a4d576b3307f" released by "_delete_snapshot" :: held 1.959s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" released by "delete_snapshot" :: held 1.977s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:55 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Created reservations ['c09e057e-b670-4249-b655-0fc0e36d27aa', '123524a5-18ae-40f2-bb4a-c509221257d7', '6aad0fe0-003b-4ed2-9720-53d7ab6e43b8', 'abcc0ce9-e099-4c1c-b5c0-7e5dc45ce430'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:55 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Delete snapshot completed successfully. Feb 27 22:29:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d7262fad-8ae4-4ca1-a4ac-1b8850a6a432 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-e279be6d-ec47-46ff-b862-a4d576b3307f-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-71654ead-42fc-45f0-8aa2-67200e00d162-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-71654ead-42fc-45f0-8aa2-67200e00d162-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:29:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:29:56 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cbee2e-c2a1-424e-b6bc-9f291dfa25e9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:29:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:56 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 Feb 27 22:29:56 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:56 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162" returned: 0 in 0.494s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:56 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162 Feb 27 22:29:56 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:57 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-71654ead-42fc-45f0-8aa2-67200e00d162" returned: 0 in 0.441s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-quobyte-71654ead-42fc-45f0-8aa2-67200e00d162" released by "delete_volume" :: held 0.967s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Created reservations ['58adb47e-c9bd-4a80-8f37-53d22551c501', 'a36bd5d8-57a9-41b3-9a1c-ea3be9bcd86a', '9e9fc592-4dd5-446c-a392-99cfdb8fbe2b', '6b958116-bfce-4ff5-ba01-209961014480'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:57 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:29:57 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:57 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.457s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:29:57 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Deleted volume successfully. Feb 27 22:29:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-20b31180-b419-4531-a2e3-cc9f11a85936 tempest-VolumesSnapshotListTestJSON-1483667013 None] Lock "cinder-71654ead-42fc-45f0-8aa2-67200e00d162-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (62843a72-5336-4c81-8be3-aefb7c22d43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93107aca-c9b9-430b-a618-2054b5cce31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93107aca-c9b9-430b-a618-2054b5cce31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1873296028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5de378d-2ef0-455c-98bc-03829e86c05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:59Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2657d210-6293-4842-a5df-be2916a1fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2657d210-6293-4842-a5df-be2916a1fa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da95ea3-fa0b-4b70-9821-826d1a6bada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da95ea3-fa0b-4b70-9821-826d1a6bada8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5de378d-2ef0-455c-98bc-03829e86c05e', 'volume_name': 'volume-b5de378d-2ef0-455c-98bc-03829e86c05e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32617e7c-45aa-46b6-a72b-079589d0d4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32617e7c-45aa-46b6-a72b-079589d0d4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bc780f-d0b7-414e-8c45-edbb1ab8fb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:58 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Volume b5de378d-2ef0-455c-98bc-03829e86c05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5de378d-2ef0-455c-98bc-03829e86c05e', 'volume_size': 1} Feb 27 22:29:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1873296028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5de378d-2ef0-455c-98bc-03829e86c05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:59Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Creating volume b5de378d-2ef0-455c-98bc-03829e86c05e {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:29:59 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:59 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e 1073741824 Feb 27 22:29:59 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (f1d6098e-696d-4e3b-b075-3e1c36aa222e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418937b4-0675-45b2-b55c-da9d0e28278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418937b4-0675-45b2-b55c-da9d0e28278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1280425332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18b4876-9bb1-4997-9689-676d25f3e18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:59Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9de56b-8596-4c31-ba71-7e496558526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9de56b-8596-4c31-ba71-7e496558526b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6211a7fe-d742-4de7-8881-af969649e62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6211a7fe-d742-4de7-8881-af969649e62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18b4876-9bb1-4997-9689-676d25f3e18d', 'volume_name': 'volume-d18b4876-9bb1-4997-9689-676d25f3e18d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9626b15-3284-486d-bef5-034ae1487c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9626b15-3284-486d-bef5-034ae1487c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db6a878-443c-486f-9d47-e17b536d0257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Volume d18b4876-9bb1-4997-9689-676d25f3e18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18b4876-9bb1-4997-9689-676d25f3e18d', 'volume_size': 1} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (a5c69010-2189-44de-80bc-278ab005a98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa33576-ba10-4c8d-970e-6e2e06d6bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa33576-ba10-4c8d-970e-6e2e06d6bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1765242273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6306ff33-7a23-436b-a49e-c35b5923e238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:59Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad95e18a-9936-4f73-8166-b8879f24f8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad95e18a-9936-4f73-8166-b8879f24f8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37248e32-8fc2-4f06-9463-286469b41abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37248e32-8fc2-4f06-9463-286469b41abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6306ff33-7a23-436b-a49e-c35b5923e238', 'volume_name': 'volume-6306ff33-7a23-436b-a49e-c35b5923e238', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4550ad5-c760-49f4-87fb-6eac20337721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4550ad5-c760-49f4-87fb-6eac20337721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f6666d-cfb2-45ca-9672-99d6e623d473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Volume 6306ff33-7a23-436b-a49e-c35b5923e238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6306ff33-7a23-436b-a49e-c35b5923e238', 'volume_size': 1} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (91e4670b-ecc9-4742-ba6f-518a847a5739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437e5aac-c775-476f-b7b6-8b35024adf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437e5aac-c775-476f-b7b6-8b35024adf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1977056382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e64955f-e43a-4580-8227-910fe902098b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:00Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364f4b5c-8ce1-413a-a592-1e276e49277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364f4b5c-8ce1-413a-a592-1e276e49277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2981aa-923b-4fb0-a180-b805748c739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2981aa-923b-4fb0-a180-b805748c739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e64955f-e43a-4580-8227-910fe902098b', 'volume_name': 'volume-0e64955f-e43a-4580-8227-910fe902098b', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0566b0e1-8c0a-448f-b26d-0bfc63f03864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0566b0e1-8c0a-448f-b26d-0bfc63f03864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca1bff5-2e43-4478-aaec-e5328571baa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Volume 0e64955f-e43a-4580-8227-910fe902098b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e64955f-e43a-4580-8227-910fe902098b', 'volume_size': 1} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:29:59 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e 1073741824" returned: 0 in 0.602s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:29:59 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e Feb 27 22:29:59 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (9fed774a-6c74-4001-8afc-63494b495b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d847e21a-6530-423b-8755-4e9e14ae1f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d847e21a-6530-423b-8755-4e9e14ae1f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58975213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3269ec07-674d-4c9d-8ff7-f7d8ae729e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:00Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a2172c-5c4a-435c-ae9a-267ecb51e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a2172c-5c4a-435c-ae9a-267ecb51e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001a744c-4c67-477f-83d6-45dfe9e203b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001a744c-4c67-477f-83d6-45dfe9e203b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3269ec07-674d-4c9d-8ff7-f7d8ae729e44', 'volume_name': 'volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d9fc01-f9cf-41d6-aac1-44edb6f24485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d9fc01-f9cf-41d6-aac1-44edb6f24485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e30d149-6ff4-41e5-8352-074826686529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:29:59 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Volume 3269ec07-674d-4c9d-8ff7-f7d8ae729e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44', 'volume_size': 1} Feb 27 22:29:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:00 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e" returned: 0 in 0.450s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.904s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1280425332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18b4876-9bb1-4997-9689-676d25f3e18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:59Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Creating volume d18b4876-9bb1-4997-9689-676d25f3e18d {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:00 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bc780f-d0b7-414e-8c45-edbb1ab8fb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5de378d-2ef0-455c-98bc-03829e86c05e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dab492-a3be-4530-b3d8-e80bef5474d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:00 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d 1073741824 Feb 27 22:30:00 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:00 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Volume volume-b5de378d-2ef0-455c-98bc-03829e86c05e (b5de378d-2ef0-455c-98bc-03829e86c05e): created successfully Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dab492-a3be-4530-b3d8-e80bef5474d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (62843a72-5336-4c81-8be3-aefb7c22d43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-832dc3ce-f972-456a-801e-4550bf8fbfad tempest-CreateVolumesFromImageTest-2099310882 None] Created volume successfully. Feb 27 22:30:00 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d 1073741824" returned: 0 in 0.506s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:00 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d Feb 27 22:30:00 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:01 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d" returned: 0 in 0.444s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1765242273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6306ff33-7a23-436b-a49e-c35b5923e238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:29:59Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Creating volume 6306ff33-7a23-436b-a49e-c35b5923e238 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:01 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db6a878-443c-486f-9d47-e17b536d0257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18b4876-9bb1-4997-9689-676d25f3e18d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b119c9d-bf52-4167-a6ca-d1008cacb9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:01 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 1073741824 Feb 27 22:30:01 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:01 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Volume volume-d18b4876-9bb1-4997-9689-676d25f3e18d (d18b4876-9bb1-4997-9689-676d25f3e18d): created successfully Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b119c9d-bf52-4167-a6ca-d1008cacb9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (f1d6098e-696d-4e3b-b075-3e1c36aa222e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:01 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-91559de0-22c5-48cf-ba98-6efe466a7e39 tempest-CreateVolumesFromImageTest-2099310882 None] Created volume successfully. Feb 27 22:30:01 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 1073741824" returned: 0 in 0.471s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:01 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 Feb 27 22:30:01 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:02 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238" returned: 0 in 0.448s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.429s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1977056382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e64955f-e43a-4580-8227-910fe902098b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:00Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Creating volume 0e64955f-e43a-4580-8227-910fe902098b {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:02 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f6666d-cfb2-45ca-9672-99d6e623d473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6306ff33-7a23-436b-a49e-c35b5923e238', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:02 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b 1073741824 Feb 27 22:30:02 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5bd1f6-23ca-4adc-8882-9531c60862a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:02 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Volume volume-6306ff33-7a23-436b-a49e-c35b5923e238 (6306ff33-7a23-436b-a49e-c35b5923e238): created successfully Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5bd1f6-23ca-4adc-8882-9531c60862a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (a5c69010-2189-44de-80bc-278ab005a98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:02 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c6aa668e-58fb-4594-ba27-69412c0e502c tempest-CreateVolumesFromImageTest-2099310882 None] Created volume successfully. Feb 27 22:30:02 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b 1073741824" returned: 0 in 0.461s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:02 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b Feb 27 22:30:02 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:02 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b" returned: 0 in 0.386s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.069s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58975213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3269ec07-674d-4c9d-8ff7-f7d8ae729e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c051b81c08d4c009388a2c96c465796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:00Z,use_quota=True,user_id='fb89db17b7c94cf1af0d3cec39d3ea5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Creating volume 3269ec07-674d-4c9d-8ff7-f7d8ae729e44 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:02 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca1bff5-2e43-4478-aaec-e5328571baa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e64955f-e43a-4580-8227-910fe902098b', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ac05b1-ab6d-4879-ad55-ecdaddfee004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:02 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 1073741824 Feb 27 22:30:02 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:02 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Volume volume-0e64955f-e43a-4580-8227-910fe902098b (0e64955f-e43a-4580-8227-910fe902098b): created successfully Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ac05b1-ab6d-4879-ad55-ecdaddfee004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:02 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (91e4670b-ecc9-4742-ba6f-518a847a5739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:02 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9e3665ca-5f8c-419b-b2bd-c7b694878bba tempest-CreateVolumesFromImageTest-2099310882 None] Created volume successfully. Feb 27 22:30:03 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 1073741824" returned: 0 in 0.490s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:03 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 Feb 27 22:30:03 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:03 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44" returned: 0 in 0.429s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e30d149-6ff4-41e5-8352-074826686529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b06eeb-b9cf-4c4a-aaf2-100adf30a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:03 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Volume volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 (3269ec07-674d-4c9d-8ff7-f7d8ae729e44): created successfully Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b06eeb-b9cf-4c4a-aaf2-100adf30a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Flow 'volume_create_manager' (9fed774a-6c74-4001-8afc-63494b495b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4527c362-e3f0-4941-97b9-a8c5235aae14 tempest-CreateVolumesFromImageTest-2099310882 None] Created volume successfully. Feb 27 22:30:03 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=154,cinder:SELECT=118,cinder:INSERT=41,cinder:DELETE=16 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:30:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-3269ec07-674d-4c9d-8ff7-f7d8ae729e44-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-3269ec07-674d-4c9d-8ff7-f7d8ae729e44-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-quobyte-3269ec07-674d-4c9d-8ff7-f7d8ae729e44" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-3269ec07-674d-4c9d-8ff7-f7d8ae729e44" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:04 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d17d8-b602-4144-a584-91162fcbb310]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:04 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 Feb 27 22:30:04 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:04 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44" returned: 0 in 0.458s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:04 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44 Feb 27 22:30:04 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:05 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3269ec07-674d-4c9d-8ff7-f7d8ae729e44" returned: 0 in 0.400s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-3269ec07-674d-4c9d-8ff7-f7d8ae729e44" released by "delete_volume" :: held 0.888s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Created reservations ['f668fc7e-a9f0-418c-8b39-e6b4902e6bf8', 'fce4f7a1-43b7-4ae7-ad3d-a35570af915a', 'd38e96ca-7169-4235-af9d-75420218fb10', '8de8fb6e-478a-4152-b06d-7253b9444d4d'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:05 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:05 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-0e64955f-e43a-4580-8227-910fe902098b-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-0e64955f-e43a-4580-8227-910fe902098b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-quobyte-0e64955f-e43a-4580-8227-910fe902098b" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-0e64955f-e43a-4580-8227-910fe902098b" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f343b57-c321-43dd-9561-25db784ba0ac]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:05 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b Feb 27 22:30:05 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:05 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.426s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:05 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Deleted volume successfully. Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-50204c35-4cc7-4474-b8d8-c4dcda23e878 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-3269ec07-674d-4c9d-8ff7-f7d8ae729e44-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:05 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b" returned: 0 in 0.468s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:05 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b Feb 27 22:30:05 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:06 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-0e64955f-e43a-4580-8227-910fe902098b" returned: 0 in 0.387s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-0e64955f-e43a-4580-8227-910fe902098b" released by "delete_volume" :: held 0.885s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Created reservations ['e8e4685d-8a34-4906-a12d-f8c4d9d11aba', '7ca097f5-2733-4f4e-bf59-00cd12768487', '498e9b80-6ce3-4b94-81af-abe3556f4e4d', '7f7b5b3d-40b8-459e-8d34-a9e08cef63ad'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:06 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:06 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-6306ff33-7a23-436b-a49e-c35b5923e238-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-6306ff33-7a23-436b-a49e-c35b5923e238-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-quobyte-6306ff33-7a23-436b-a49e-c35b5923e238" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-6306ff33-7a23-436b-a49e-c35b5923e238" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb671b2-26d8-48c9-812c-f09dc549a383]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:06 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 Feb 27 22:30:06 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:06 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.426s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:06 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Deleted volume successfully. Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-843a7048-102c-41af-91a2-67bb8026b152 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-0e64955f-e43a-4580-8227-910fe902098b-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:06 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238" returned: 0 in 0.469s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:06 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238 Feb 27 22:30:06 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:07 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-6306ff33-7a23-436b-a49e-c35b5923e238" returned: 0 in 0.400s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-6306ff33-7a23-436b-a49e-c35b5923e238" released by "delete_volume" :: held 0.896s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Created reservations ['fbd3c9f4-d381-4c47-bb07-1ea7480b2011', '342db34b-e794-4711-a087-a277d36e06f0', '6a7599f3-9f1b-4f4d-9eab-147f53ccf198', '63c0e9c4-1798-4a42-b461-72986847a59b'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:07 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:07 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-d18b4876-9bb1-4997-9689-676d25f3e18d-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-d18b4876-9bb1-4997-9689-676d25f3e18d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-quobyte-d18b4876-9bb1-4997-9689-676d25f3e18d" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-d18b4876-9bb1-4997-9689-676d25f3e18d" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce63c3a-7275-4021-9fe7-c171a4368ba8]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:07 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d Feb 27 22:30:07 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:07 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.424s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:07 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Deleted volume successfully. Feb 27 22:30:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-149914d6-1d2c-4c5a-b649-5ed39d595e9c tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-6306ff33-7a23-436b-a49e-c35b5923e238-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:08 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d" returned: 0 in 0.479s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:08 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d Feb 27 22:30:08 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:08 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d18b4876-9bb1-4997-9689-676d25f3e18d" returned: 0 in 0.387s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-d18b4876-9bb1-4997-9689-676d25f3e18d" released by "delete_volume" :: held 0.899s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Created reservations ['31e9d470-ca01-4f21-85e9-5e543c9966f2', 'e1c8d46c-fd43-4478-839c-83cd8abbf431', 'e9fd6f81-a915-4bc6-87c8-34312a4d32e9', '9fb82f7e-187f-4b75-846b-59a45f33f3d4'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:08 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:08 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-b5de378d-2ef0-455c-98bc-03829e86c05e-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-b5de378d-2ef0-455c-98bc-03829e86c05e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "cinder-quobyte-b5de378d-2ef0-455c-98bc-03829e86c05e" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-b5de378d-2ef0-455c-98bc-03829e86c05e" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca66ee3-d602-4045-99bb-adc910c2c5b9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:08 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e Feb 27 22:30:08 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:09 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.434s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:09 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Deleted volume successfully. Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1b518c63-fe21-44f6-a99e-af8455f63780 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-d18b4876-9bb1-4997-9689-676d25f3e18d-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:09 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e" returned: 0 in 0.476s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:09 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e Feb 27 22:30:09 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:09 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b5de378d-2ef0-455c-98bc-03829e86c05e" returned: 0 in 0.407s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-quobyte-b5de378d-2ef0-455c-98bc-03829e86c05e" released by "delete_volume" :: held 0.919s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Created reservations ['d12d7a98-d4eb-4c33-adcb-bf53c1209bc8', 'd39224e7-0640-4d26-8634-d79d714040ec', '2d671f7f-8552-4c19-916c-6decac90899c', '3311ac99-2aaa-4acd-ae98-6f7393c60686'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:09 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:09 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:10 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:10 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:10 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Deleted volume successfully. Feb 27 22:30:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d1a57b47-83dd-4525-9b37-c8bee2d1b2b3 tempest-CreateVolumesFromImageTest-2099310882 None] Lock "cinder-b5de378d-2ef0-455c-98bc-03829e86c05e-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (9690a00a-b5dc-4c31-aee6-a4e8e59df169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae78503-8f7f-4dca-8dce-86540f40e9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae78503-8f7f-4dca-8dce-86540f40e9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730259409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c545f6b9-5aac-48bc-86e9-10312c4ab539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:11Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde7ad20-4cee-41ef-a5f0-2590358344c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde7ad20-4cee-41ef-a5f0-2590358344c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e8a1b2-38c9-4da6-8676-b1b5c699cff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e8a1b2-38c9-4da6-8676-b1b5c699cff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c545f6b9-5aac-48bc-86e9-10312c4ab539', 'volume_name': 'volume-c545f6b9-5aac-48bc-86e9-10312c4ab539', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18107e3b-9b7d-45cf-aaa0-447e80b4003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18107e3b-9b7d-45cf-aaa0-447e80b4003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b5cc1f-b428-4335-84dd-c3012121f718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:11 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume c545f6b9-5aac-48bc-86e9-10312c4ab539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c545f6b9-5aac-48bc-86e9-10312c4ab539', 'volume_size': 1} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730259409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c545f6b9-5aac-48bc-86e9-10312c4ab539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:11Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Creating volume c545f6b9-5aac-48bc-86e9-10312c4ab539 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:11 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:11 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 1073741824 Feb 27 22:30:11 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:12 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 1073741824" returned: 0 in 0.478s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:12 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 Feb 27 22:30:12 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:12 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539" returned: 0 in 0.410s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b5cc1f-b428-4335-84dd-c3012121f718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c545f6b9-5aac-48bc-86e9-10312c4ab539', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f9c930-d319-4704-84d7-a87f5d7c693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:12 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 (c545f6b9-5aac-48bc-86e9-10312c4ab539): created successfully Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f9c930-d319-4704-84d7-a87f5d7c693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (9690a00a-b5dc-4c31-aee6-a4e8e59df169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:12 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3c70a660-b77e-4dd2-bc0f-9cc67933de38 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created volume successfully. Feb 27 22:30:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:13 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Creating offline snapshot 35686069-e913-4e39-8b29-1cb1a5dd463b of volume c545f6b9-5aac-48bc-86e9-10312c4ab539 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:30:13 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2414ab89-8c67-49b4-ad32-3b58d2795966]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:13 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 Feb 27 22:30:13 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:14 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539" returned: 0 in 0.466s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:14 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b 1G Feb 27 22:30:14 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:14 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b 1G" returned: 0 in 0.461s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:14 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b Feb 27 22:30:14 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:15 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b" returned: 0 in 0.439s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:15 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b is being set with open permissions: ugo+rw Feb 27 22:30:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:15 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b Feb 27 22:30:15 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:15 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b" returned: 0 in 0.412s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:15 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.info Feb 27 22:30:15 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:15 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.info" returned: 0 in 0.425s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:15 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.info is being set with open permissions: ugo+rw Feb 27 22:30:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:15 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.info Feb 27 22:30:15 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:16 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.info" returned: 0 in 0.392s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:16 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e3f131e1-2872-4879-882a-23de9694e3f1 tempest-CreateVolumesFromSnapshotTest-511178019 None] Create snapshot completed successfully Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (51e572b7-8caf-4218-983d-53f93d18efa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276c2c0c-816e-463e-bab7-b07560f04a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276c2c0c-816e-463e-bab7-b07560f04a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1830663754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36730a9-bcc6-4b12-832b-27e1ef294b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:17Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca395fe4-c615-49d1-a4d0-1167bde4a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca395fe4-c615-49d1-a4d0-1167bde4a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1120a726-fa12-44b6-b5bc-e2097f226a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1120a726-fa12-44b6-b5bc-e2097f226a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36730a9-bcc6-4b12-832b-27e1ef294b22', 'volume_name': 'volume-e36730a9-bcc6-4b12-832b-27e1ef294b22', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f21511-4f34-497f-8e48-d4d41688c6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f21511-4f34-497f-8e48-d4d41688c6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4a549c-0bac-4f89-83a3-d7b29ac21de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume e36730a9-bcc6-4b12-832b-27e1ef294b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36730a9-bcc6-4b12-832b-27e1ef294b22', 'volume_size': 1} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1830663754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36730a9-bcc6-4b12-832b-27e1ef294b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:17Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Creating volume e36730a9-bcc6-4b12-832b-27e1ef294b22 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:17 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:17 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 1073741824 Feb 27 22:30:17 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (4bd85a6e-70a0-4808-9f0f-92a01ea213bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981fdce7-d4b2-4a4f-adac-86bf9737183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981fdce7-d4b2-4a4f-adac-86bf9737183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-382382474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4d45d9-22bc-4b14-ab9a-43ab52859606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:17Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a4a3f2-0432-43a6-b027-fa40269cc983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a4a3f2-0432-43a6-b027-fa40269cc983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010bc2cb-e5c0-4c97-9579-3eee6666a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010bc2cb-e5c0-4c97-9579-3eee6666a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4d45d9-22bc-4b14-ab9a-43ab52859606', 'volume_name': 'volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622c465b-9558-45ce-a8c0-b5ca60668573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622c465b-9558-45ce-a8c0-b5ca60668573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be98f99-293b-45ab-a63c-7919a525ab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume 8e4d45d9-22bc-4b14-ab9a-43ab52859606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606', 'volume_size': 1} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (c55da572-0fcd-45bd-b4ed-1f186f282424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248215d9-5723-4460-84ab-e06e96c0b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248215d9-5723-4460-84ab-e06e96c0b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005050277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:17Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700f4fd0-8678-4cac-8a98-540102cdb6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700f4fd0-8678-4cac-8a98-540102cdb6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4899e8b2-c35f-4e4e-a8a9-f09aa3a1ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4899e8b2-c35f-4e4e-a8a9-f09aa3a1ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9', 'volume_name': 'volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f38894-b2f8-4721-a514-7c407e070a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f38894-b2f8-4721-a514-7c407e070a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1955e5fa-17db-436b-8e7a-33520cb524a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume 41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9', 'volume_size': 1} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (84716f57-40dd-4d14-b46f-fa5f1e439bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68ddc25-33c0-4653-a123-c9dfcd906015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 1073741824" returned: 0 in 0.543s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68ddc25-33c0-4653-a123-c9dfcd906015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1280077368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:18Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40b9189-1482-4095-b9e3-164b2c7dc676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40b9189-1482-4095-b9e3-164b2c7dc676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e7fda5-dbf2-4b06-8899-dd1a8f117968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e7fda5-dbf2-4b06-8899-dd1a8f117968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f4b5ee-7df7-48a7-8be7-4c7a083bd98c', 'volume_name': 'volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e68c62-ed3c-4c47-98b9-0c4d4e766a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e68c62-ed3c-4c47-98b9-0c4d4e766a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135740cd-bc68-4dae-909e-1949071922cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c', 'volume_size': 1} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:17 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 Feb 27 22:30:17 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (0a4da467-f9a5-4497-b112-decef69d16c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5015f011-b40e-43e2-b6cf-4c1fea998db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5015f011-b40e-43e2-b6cf-4c1fea998db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806482448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777e732a-bd5f-4bb7-abbd-a5863e51b6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:18Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e748b97-2d77-4f5d-abcf-1b10685fbca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e748b97-2d77-4f5d-abcf-1b10685fbca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b70d80e-9f65-4241-9339-6236744ec34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b70d80e-9f65-4241-9339-6236744ec34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777e732a-bd5f-4bb7-abbd-a5863e51b6e9', 'volume_name': 'volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37116976-8adf-4264-946d-f5eac02dc2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37116976-8adf-4264-946d-f5eac02dc2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0a1cf0-736c-40fd-8bd8-c1c08e7ac79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume 777e732a-bd5f-4bb7-abbd-a5863e51b6e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9', 'volume_size': 1} Feb 27 22:30:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:18 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22" returned: 0 in 0.428s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-382382474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4d45d9-22bc-4b14-ab9a-43ab52859606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:17Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Creating volume 8e4d45d9-22bc-4b14-ab9a-43ab52859606 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:18 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4a549c-0bac-4f89-83a3-d7b29ac21de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36730a9-bcc6-4b12-832b-27e1ef294b22', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81291996-dcec-43a2-a1de-8324e71ff699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:18 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 1073741824 Feb 27 22:30:18 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:18 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 (e36730a9-bcc6-4b12-832b-27e1ef294b22): created successfully Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81291996-dcec-43a2-a1de-8324e71ff699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (51e572b7-8caf-4218-983d-53f93d18efa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:18 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7dc723c3-5d38-439e-8de4-2bc5bcd4f726 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created volume successfully. Feb 27 22:30:18 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 1073741824" returned: 0 in 0.470s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:18 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 Feb 27 22:30:18 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:19 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606" returned: 0 in 0.413s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005050277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:17Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Creating volume 41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:19 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be98f99-293b-45ab-a63c-7919a525ab7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56acfd81-356a-475a-aff3-5d5d1120fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:19 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 1073741824 Feb 27 22:30:19 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:19 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 (8e4d45d9-22bc-4b14-ab9a-43ab52859606): created successfully Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56acfd81-356a-475a-aff3-5d5d1120fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (4bd85a6e-70a0-4808-9f0f-92a01ea213bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:19 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8145b8c4-c8cc-4b30-bf04-b4fbb79254d6 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created volume successfully. Feb 27 22:30:19 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 1073741824" returned: 0 in 0.471s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:19 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 Feb 27 22:30:19 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:19 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9" returned: 0 in 0.415s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1280077368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:18Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Creating volume d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:19 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1955e5fa-17db-436b-8e7a-33520cb524a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9353aee6-4ae4-4e22-9418-ba161fad9c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:20 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c 1073741824 Feb 27 22:30:20 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:20 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 (41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9): created successfully Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9353aee6-4ae4-4e22-9418-ba161fad9c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (c55da572-0fcd-45bd-b4ed-1f186f282424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:20 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6ae2f346-1d8d-4d70-8b34-67f079790a6f tempest-CreateVolumesFromSnapshotTest-511178019 None] Created volume successfully. Feb 27 22:30:20 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c 1073741824" returned: 0 in 0.481s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:20 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c Feb 27 22:30:20 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:20 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c" returned: 0 in 0.405s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806482448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777e732a-bd5f-4bb7-abbd-a5863e51b6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fa09da197a4910a98200ee37275494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:18Z,use_quota=True,user_id='a8a40d774b4f4475b1bf6e74e0707c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Creating volume 777e732a-bd5f-4bb7-abbd-a5863e51b6e9 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:20 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135740cd-bc68-4dae-909e-1949071922cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad44267-83bc-45b0-930b-6515904aaa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:20 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 1073741824 Feb 27 22:30:20 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:20 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c (d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c): created successfully Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad44267-83bc-45b0-930b-6515904aaa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (84716f57-40dd-4d14-b46f-fa5f1e439bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:20 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e6d1b23d-8d70-4d18-8d35-23eaea7c3681 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created volume successfully. Feb 27 22:30:21 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 1073741824" returned: 0 in 0.498s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:21 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 Feb 27 22:30:21 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:21 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9" returned: 0 in 0.414s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0a1cf0-736c-40fd-8bd8-c1c08e7ac79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01258105-9f67-460a-b52a-cdf4fc0a2595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:21 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Volume volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 (777e732a-bd5f-4bb7-abbd-a5863e51b6e9): created successfully Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01258105-9f67-460a-b52a-cdf4fc0a2595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Flow 'volume_create_manager' (0a4da467-f9a5-4497-b112-decef69d16c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:21 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f26436c4-a188-48a8-aaa7-16c3072e3287 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created volume successfully. Feb 27 22:30:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-777e732a-bd5f-4bb7-abbd-a5863e51b6e9-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-777e732a-bd5f-4bb7-abbd-a5863e51b6e9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-quobyte-777e732a-bd5f-4bb7-abbd-a5863e51b6e9" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-777e732a-bd5f-4bb7-abbd-a5863e51b6e9" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:22 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[296360ff-6aab-485f-ad11-bf606d061950]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:22 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 Feb 27 22:30:22 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:22 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9" returned: 0 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:22 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9 Feb 27 22:30:22 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:23 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-777e732a-bd5f-4bb7-abbd-a5863e51b6e9" returned: 0 in 0.388s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-777e732a-bd5f-4bb7-abbd-a5863e51b6e9" released by "delete_volume" :: held 0.923s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created reservations ['907a4ff5-f559-410f-9b24-0df62ba4a436', '9ced4f38-e29f-4a23-a481-64050466813b', 'ca1b4848-433a-4085-8e19-18595f11d346', '1c8844b5-4e83-47e5-b87b-e7450a35c529'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:23 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:23 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-quobyte-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58de6a2-ade4-4197-b6cd-fe9f7be1a1d1]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:23 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.415s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:23 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:23 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:23 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Deleted volume successfully. Feb 27 22:30:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-41ba4803-9677-421c-8467-43bb3f764415 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-777e732a-bd5f-4bb7-abbd-a5863e51b6e9-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:24 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c" returned: 0 in 0.492s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:24 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c Feb 27 22:30:24 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:24 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c" returned: 0 in 0.400s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c" released by "delete_volume" :: held 0.915s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created reservations ['e083670c-2e2d-490a-aef4-fd2f1e59e98a', '13cdecf8-4110-44ab-8098-945ed3d61265', '62cf8d80-efb0-4019-87a6-3e897373517a', '01918368-0e77-4f45-9dc6-e1a4ae2e48b0'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:24 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:24 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-quobyte-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deaa788-f718-4b81-9da5-2ba10f684a0e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:24 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 Feb 27 22:30:24 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:24 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.455s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:24 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:24 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Deleted volume successfully. Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c2828d5b-112d-4667-918e-01cfa301b273 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-d5f4b5ee-7df7-48a7-8be7-4c7a083bd98c-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:25 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9" returned: 0 in 0.496s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:25 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9 Feb 27 22:30:25 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:25 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9" returned: 0 in 0.426s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9" released by "delete_volume" :: held 0.946s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created reservations ['ddc71bfd-bda4-4753-820a-412f9c7a9bf1', 'a6ecc417-7452-49ac-9f32-04d8668f9f31', '13b7af05-a2d7-47d5-bbe4-fec276ac3837', 'd264c063-2207-4339-9f1d-c637cd511ef8'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:25 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:25 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-8e4d45d9-22bc-4b14-ab9a-43ab52859606-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-8e4d45d9-22bc-4b14-ab9a-43ab52859606-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-quobyte-8e4d45d9-22bc-4b14-ab9a-43ab52859606" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-8e4d45d9-22bc-4b14-ab9a-43ab52859606" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a431d-a86f-4312-a727-e25a68b8e008]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:25 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 Feb 27 22:30:25 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:26 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.437s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:26 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Deleted volume successfully. Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2ac01b28-e55a-4eca-9aa3-5f5acb6b4259 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-41c0bf46-a96e-4ebb-ba47-02dc9d3f52b9-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:26 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606" returned: 0 in 0.503s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:26 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606 Feb 27 22:30:26 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:26 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-8e4d45d9-22bc-4b14-ab9a-43ab52859606" returned: 0 in 0.400s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-8e4d45d9-22bc-4b14-ab9a-43ab52859606" released by "delete_volume" :: held 0.937s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Created reservations ['d16d0735-478a-43db-b4bd-0e9da8a99791', '7f9375fb-dfbb-4eb3-a9fb-9e3a3521a093', '2a4843f7-8740-407f-b20a-d2468da16f3c', '56dce6e2-74fc-450a-958f-2b38d4da370e'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:26 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:26 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-e36730a9-bcc6-4b12-832b-27e1ef294b22-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-e36730a9-bcc6-4b12-832b-27e1ef294b22-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-quobyte-e36730a9-bcc6-4b12-832b-27e1ef294b22" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-e36730a9-bcc6-4b12-832b-27e1ef294b22" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd38080d-70e4-4fa6-a892-0f89644849e8]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:27 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 Feb 27 22:30:27 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:27 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.450s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:27 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Deleted volume successfully. Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8b2f5a65-7a16-4b26-aa93-58b51832c64d tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-8e4d45d9-22bc-4b14-ab9a-43ab52859606-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:27 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22" returned: 0 in 0.485s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:27 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22 Feb 27 22:30:27 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:27 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e36730a9-bcc6-4b12-832b-27e1ef294b22" returned: 0 in 0.409s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-e36730a9-bcc6-4b12-832b-27e1ef294b22" released by "delete_volume" :: held 0.917s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created reservations ['9dfc7b8f-7456-4ba1-9139-fea23d2cd54c', '62137ac3-62fb-4870-8602-a5fa3d92df68', '5b6bfe81-7163-4163-8341-c11beb0bcb29', '565bb0d3-3729-465a-bfd3-734ec5843676'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:27 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:27 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-35686069-e913-4e39-8b29-1cb1a5dd463b-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-35686069-e913-4e39-8b29-1cb1a5dd463b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-quobyte-c545f6b9-5aac-48bc-86e9-10312c4ab539" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-c545f6b9-5aac-48bc-86e9-10312c4ab539" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-quobyte-35686069-e913-4e39-8b29-1cb1a5dd463b" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-35686069-e913-4e39-8b29-1cb1a5dd463b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Deleting offline snapshot 35686069-e913-4e39-8b29-1cb1a5dd463b of volume c545f6b9-5aac-48bc-86e9-10312c4ab539 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] snapshot_file for this snap is: volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a1c31-057e-4af3-8c23-ae68d4402242]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:28 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b Feb 27 22:30:28 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:28 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.416s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:28 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Deleted volume successfully. Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4e58a39a-3bc3-438c-a173-560281f2a452 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-e36730a9-bcc6-4b12-832b-27e1ef294b22-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:28 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b" returned: 0 in 0.478s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c545f6b9-5aac-48bc-86e9-10312c4ab539(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf22e8-548e-40a4-bd16-72ead36b6734]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:28 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 Feb 27 22:30:28 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:29 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539" returned: 0 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:29 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b Feb 27 22:30:29 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:29 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b" returned: 0 in 0.445s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:29 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b Feb 27 22:30:29 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:29 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539.35686069-e913-4e39-8b29-1cb1a5dd463b" returned: 0 in 0.394s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-35686069-e913-4e39-8b29-1cb1a5dd463b" released by "_delete_snapshot" :: held 1.869s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-c545f6b9-5aac-48bc-86e9-10312c4ab539" released by "delete_snapshot" :: held 1.883s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Created reservations ['9a34ec39-10d1-42a1-947d-5eca1fc9b41b', 'b4e1ba75-7761-4717-8d48-9eafd4ead7d6', 'd5133a4c-389f-4ae3-b4e5-c843a6a703fd', '3fe6caf6-1415-47ee-b28c-1a6938f09d57'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:29 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Delete snapshot completed successfully. Feb 27 22:30:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c843d40a-2280-468e-b6bf-0d972a27a722 tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-35686069-e913-4e39-8b29-1cb1a5dd463b-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-c545f6b9-5aac-48bc-86e9-10312c4ab539-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-c545f6b9-5aac-48bc-86e9-10312c4ab539-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "cinder-quobyte-c545f6b9-5aac-48bc-86e9-10312c4ab539" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-c545f6b9-5aac-48bc-86e9-10312c4ab539" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe866a4-2744-447a-ad10-afecebed9a73]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:30 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 Feb 27 22:30:30 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:30 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539" returned: 0 in 0.448s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:30 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539 Feb 27 22:30:30 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:30 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c545f6b9-5aac-48bc-86e9-10312c4ab539" returned: 0 in 0.380s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-quobyte-c545f6b9-5aac-48bc-86e9-10312c4ab539" released by "delete_volume" :: held 0.865s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Created reservations ['d9ff71a8-1230-4b78-adfd-7ef295dd64bc', '3f3a383c-9572-4b22-9b95-6457b21469e3', 'b24e51a3-9c8c-43ca-92da-58003bf5e9f6', 'a4fdc1bf-85be-49da-944b-7363f35832db'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:31 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:31 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:31 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.456s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:31 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Deleted volume successfully. Feb 27 22:30:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-29cf419f-6835-4d56-b890-643b44eea17a tempest-CreateVolumesFromSnapshotTest-511178019 None] Lock "cinder-c545f6b9-5aac-48bc-86e9-10312c4ab539-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Flow 'volume_create_manager' (7793de03-64fc-4036-99a9-02284f8acd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e3544b-f045-449a-9d00-1353fffcb7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e3544b-f045-449a-9d00-1353fffcb7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1958315821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657e80d6-81df-4caf-896f-7174d8cc1986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c00455b5ba4cb19b1bc35f6892265f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:33Z,use_quota=True,user_id='d915bc1413d141b98779041f6247483a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfec499c-9946-4a82-b53d-6fafbdd6f9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfec499c-9946-4a82-b53d-6fafbdd6f9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15622e82-af18-426b-8fa4-ec161fac390b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15622e82-af18-426b-8fa4-ec161fac390b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657e80d6-81df-4caf-896f-7174d8cc1986', 'volume_name': 'volume-657e80d6-81df-4caf-896f-7174d8cc1986', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7868f32-e4d4-4ea4-be4c-22742009d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7868f32-e4d4-4ea4-be4c-22742009d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bec1fb7-3863-450f-a283-01e9b903685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:32 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Volume 657e80d6-81df-4caf-896f-7174d8cc1986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657e80d6-81df-4caf-896f-7174d8cc1986', 'volume_size': 1} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1958315821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657e80d6-81df-4caf-896f-7174d8cc1986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c00455b5ba4cb19b1bc35f6892265f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:33Z,use_quota=True,user_id='d915bc1413d141b98779041f6247483a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Creating volume 657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:32 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:32 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 1073741824 Feb 27 22:30:32 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:33 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 1073741824" returned: 0 in 0.475s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:INSERT=50,cinder:UPDATE=206,cinder:SELECT=140,cinder:DELETE=22 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:33 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 Feb 27 22:30:33 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:33 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986" returned: 0 in 0.395s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bec1fb7-3863-450f-a283-01e9b903685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657e80d6-81df-4caf-896f-7174d8cc1986', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec35db9-3e26-48b9-8b72-60b66e9509e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:33 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Volume volume-657e80d6-81df-4caf-896f-7174d8cc1986 (657e80d6-81df-4caf-896f-7174d8cc1986): created successfully Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec35db9-3e26-48b9-8b72-60b66e9509e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:33 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Flow 'volume_create_manager' (7793de03-64fc-4036-99a9-02284f8acd4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b3951b75-b591-4bf1-b50a-7277a8a2be2d tempest-VolumeDependencyTests-2139820362 None] Created volume successfully. Feb 27 22:30:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Creating offline snapshot 1f454df0-1fad-4ed1-8c77-d8422c38c6db of volume 657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:30:35 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9953e5-4845-4f64-a4fd-ff1901fd646e]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:35 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 Feb 27 22:30:35 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:35 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986" returned: 0 in 0.458s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:35 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db 1G Feb 27 22:30:35 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:36 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db 1G" returned: 0 in 0.438s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e80d6-81df-4caf-896f-7174d8cc1986 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:36 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e80d6-81df-4caf-896f-7174d8cc1986 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db Feb 27 22:30:36 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:36 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657e80d6-81df-4caf-896f-7174d8cc1986 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db" returned: 0 in 0.400s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:36 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db is being set with open permissions: ugo+rw Feb 27 22:30:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:36 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db Feb 27 22:30:36 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:36 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db" returned: 0 in 0.385s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:36 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.info Feb 27 22:30:36 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:37 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.info" returned: 0 in 0.388s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:37 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.info is being set with open permissions: ugo+rw Feb 27 22:30:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:37 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.info Feb 27 22:30:37 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:37 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.info" returned: 0 in 0.382s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:37 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-39e7b07a-e681-4ab5-8618-ac33df8bb906 tempest-VolumeDependencyTests-2139820362 None] Create snapshot completed successfully Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Flow 'volume_create_manager' (408b8ca0-abce-4d22-8a1a-b80e87d6f99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079ee74b-67f7-4787-acc0-9702205e62e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079ee74b-67f7-4787-acc0-9702205e62e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1616763205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47884f6-9e1e-4893-9685-2b2b471cf3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c00455b5ba4cb19b1bc35f6892265f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f454df0-1fad-4ed1-8c77-d8422c38c6db,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:38Z,use_quota=True,user_id='d915bc1413d141b98779041f6247483a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11193105-4d0a-4bd3-bb01-cfc489661f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11193105-4d0a-4bd3-bb01-cfc489661f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9442b4e9-7ca7-4033-b1a0-036a8813eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9442b4e9-7ca7-4033-b1a0-036a8813eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c47884f6-9e1e-4893-9685-2b2b471cf3c7', 'volume_name': 'volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7', 'volume_size': 1, 'snapshot_id': '1f454df0-1fad-4ed1-8c77-d8422c38c6db'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0f0b19-3682-4f2b-8310-48a054b13497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0f0b19-3682-4f2b-8310-48a054b13497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de915d1-fe02-4101-b00c-8e5ac85ee10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:38 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Volume c47884f6-9e1e-4893-9685-2b2b471cf3c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7', 'volume_size': 1, 'snapshot_id': '1f454df0-1fad-4ed1-8c77-d8422c38c6db'} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-1f454df0-1fad-4ed1-8c77-d8422c38c6db-c47884f6-9e1e-4893-9685-2b2b471cf3c7" by "_create_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-1f454df0-1fad-4ed1-8c77-d8422c38c6db-c47884f6-9e1e-4893-9685-2b2b471cf3c7" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Creating volume c47884f6-9e1e-4893-9685-2b2b471cf3c7 from snapshot 1f454df0-1fad-4ed1-8c77-d8422c38c6db {{(pid=83540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-c47884f6-9e1e-4893-9685-2b2b471cf3c7" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-c47884f6-9e1e-4893-9685-2b2b471cf3c7" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] snapshot: 1f454df0-1fad-4ed1-8c77-d8422c38c6db, volume: c47884f6-9e1e-4893-9685-2b2b471cf3c7, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeb7ad8-40b9-49fb-af03-76c9f2e49e50]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:38 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db Feb 27 22:30:38 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:39 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db" returned: 0 in 0.468s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e80d6-81df-4caf-896f-7174d8cc1986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd50cb-0d37-46ae-b9d4-ca73db439821]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:39 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 Feb 27 22:30:39 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:39 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986" returned: 0 in 0.455s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:30:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:39 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 Feb 27 22:30:39 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:30:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:41 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:41 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:41 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7" returned: 0 in 1.987s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:41 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[11003d34-6350-432d-a67b-c5c703a38599]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:41 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 Feb 27 22:30:41 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:41 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.868s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:30:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:30:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:30:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:30:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:30:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:30:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:30:42 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986" returned: 0 in 0.651s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:30:42 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Converted 1024.00 MB image at 515.15 MB/s Feb 27 22:30:42 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 is being set with open permissions: ugo+rw Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:42 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 Feb 27 22:30:42 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:42 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7" returned: 0 in 0.435s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-c47884f6-9e1e-4893-9685-2b2b471cf3c7" released by "_copy_volume_from_snapshot" :: held 4.048s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-1f454df0-1fad-4ed1-8c77-d8422c38c6db-c47884f6-9e1e-4893-9685-2b2b471cf3c7" released by "_create_volume_from_snapshot" :: held 4.065s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.075s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de915d1-fe02-4101-b00c-8e5ac85ee10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7', 'volume_size': 1, 'snapshot_id': '1f454df0-1fad-4ed1-8c77-d8422c38c6db'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62870a33-37ac-4818-ad8f-523a02139f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:42 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Volume volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 (c47884f6-9e1e-4893-9685-2b2b471cf3c7): created successfully Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62870a33-37ac-4818-ad8f-523a02139f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Flow 'volume_create_manager' (408b8ca0-abce-4d22-8a1a-b80e87d6f99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-68308e91-3607-4bf5-a8a7-3d5ee4313941 tempest-VolumeDependencyTests-2139820362 None] Created volume successfully. Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-1f454df0-1fad-4ed1-8c77-d8422c38c6db-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-1f454df0-1fad-4ed1-8c77-d8422c38c6db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-657e80d6-81df-4caf-896f-7174d8cc1986" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-657e80d6-81df-4caf-896f-7174d8cc1986" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-1f454df0-1fad-4ed1-8c77-d8422c38c6db" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-1f454df0-1fad-4ed1-8c77-d8422c38c6db" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Deleting offline snapshot 1f454df0-1fad-4ed1-8c77-d8422c38c6db of volume 657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] snapshot_file for this snap is: volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[80860998-903e-4267-9981-2e949c95f698]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:42 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db Feb 27 22:30:42 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:43 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db" returned: 0 in 0.469s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657e80d6-81df-4caf-896f-7174d8cc1986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:30:43 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[085053d4-8509-441a-89fe-11e4a97bf8e1]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:43 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 Feb 27 22:30:43 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:43 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986" returned: 0 in 0.497s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:43 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db Feb 27 22:30:43 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:44 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db" returned: 0 in 0.474s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:44 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db Feb 27 22:30:44 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:44 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986.1f454df0-1fad-4ed1-8c77-d8422c38c6db" returned: 0 in 0.385s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-1f454df0-1fad-4ed1-8c77-d8422c38c6db" released by "_delete_snapshot" :: held 1.879s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-657e80d6-81df-4caf-896f-7174d8cc1986" released by "delete_snapshot" :: held 1.891s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Created reservations ['6bfcb033-6234-48f2-aaee-2192ba447e31', '10cc7ddc-d28e-4fee-999c-8d6bca6c0ee7', '3e0ea5d4-801d-4447-a1ae-f800cc80a9e2', '9247c727-5993-43ae-8f8e-784b90b1b7ab'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:44 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Delete snapshot completed successfully. Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-e0d98874-d3cf-4561-b06e-ac98b1d5050e tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-1f454df0-1fad-4ed1-8c77-d8422c38c6db-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-657e80d6-81df-4caf-896f-7174d8cc1986-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-657e80d6-81df-4caf-896f-7174d8cc1986-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-657e80d6-81df-4caf-896f-7174d8cc1986" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-657e80d6-81df-4caf-896f-7174d8cc1986" acquired by "delete_volume" :: waited 0.006s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df9a0fa-603d-42be-a8b5-ff2f161ed00f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:45 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 Feb 27 22:30:45 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:45 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986" returned: 0 in 0.476s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:45 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986 Feb 27 22:30:45 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:45 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-657e80d6-81df-4caf-896f-7174d8cc1986" returned: 0 in 0.408s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-657e80d6-81df-4caf-896f-7174d8cc1986" released by "delete_volume" :: held 0.911s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Created reservations ['30ea2633-06cd-4be2-be31-2349af0571b6', '902368d5-2653-48d5-8124-0564281a5629', 'c5ef2861-beda-4e20-8023-3dbd683190d3', '1b8e8390-da71-480b-ad22-737e74540caf'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:45 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:45 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Flow 'volume_create_manager' (a36f0dcc-6fca-4022-9002-ae1605f27e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6964c41d-c0eb-41df-85cc-7526424680f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6964c41d-c0eb-41df-85cc-7526424680f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1209735094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5453c1de-03d9-49e1-8d07-d76d050b3b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c00455b5ba4cb19b1bc35f6892265f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:46Z,use_quota=True,user_id='d915bc1413d141b98779041f6247483a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c08e63-2893-4946-9aba-ab3c561f2ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c08e63-2893-4946-9aba-ab3c561f2ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef073fb-2654-47d9-b284-c6ae8114427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef073fb-2654-47d9-b284-c6ae8114427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5453c1de-03d9-49e1-8d07-d76d050b3b2c', 'volume_name': 'volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793252ae-8a9d-496d-aeae-ac71354c399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793252ae-8a9d-496d-aeae-ac71354c399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b33dae-9555-46d6-b0eb-dea555155b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:46 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Volume 5453c1de-03d9-49e1-8d07-d76d050b3b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c', 'volume_size': 1} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1209735094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5453c1de-03d9-49e1-8d07-d76d050b3b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c00455b5ba4cb19b1bc35f6892265f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:46Z,use_quota=True,user_id='d915bc1413d141b98779041f6247483a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Creating volume 5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:30:46 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:46 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c 1073741824 Feb 27 22:30:46 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:46 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.428s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Deleted volume successfully. Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5bc392ee-713f-4913-9e53-eb1d29c1b752 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-657e80d6-81df-4caf-896f-7174d8cc1986-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:46 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c 1073741824" returned: 0 in 0.483s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:46 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c Feb 27 22:30:46 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:47 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c" returned: 0 in 0.384s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:30:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b33dae-9555-46d6-b0eb-dea555155b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4cf184-877f-4d8b-9e57-22022119af38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:47 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Volume volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c (5453c1de-03d9-49e1-8d07-d76d050b3b2c): created successfully Feb 27 22:30:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4cf184-877f-4d8b-9e57-22022119af38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Flow 'volume_create_manager' (a36f0dcc-6fca-4022-9002-ae1605f27e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:47 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-367818fc-ce73-4dff-8e17-754c0c3adf2c tempest-VolumeDependencyTests-2139820362 None] Created volume successfully. Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Flow 'volume_create_manager' (61122e69-8efd-4956-8dfd-66e5b571cf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab7af09-79e0-4b61-aa06-0e3aa15b36ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab7af09-79e0-4b61-aa06-0e3aa15b36ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2017098577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6c115b-eda6-4ec0-bab2-5c6b8ea132ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c00455b5ba4cb19b1bc35f6892265f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5453c1de-03d9-49e1-8d07-d76d050b3b2c,status='creating',terminated_at=None,updated_at=2026-02-27T21:30:49Z,use_quota=True,user_id='d915bc1413d141b98779041f6247483a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc867bd-70ad-4b82-bdb4-1b8c6368466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc867bd-70ad-4b82-bdb4-1b8c6368466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a44bab-8abf-47a9-9c65-d265baf6248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a44bab-8abf-47a9-9c65-d265baf6248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'df6c115b-eda6-4ec0-bab2-5c6b8ea132ad', 'volume_name': 'volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad', 'volume_size': 1, 'source_volid': '5453c1de-03d9-49e1-8d07-d76d050b3b2c', 'source_volstatus': 'available'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39ec208-5a1a-4064-8116-fcd5c8b5a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39ec208-5a1a-4064-8116-fcd5c8b5a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f07f6a-7d77-4ba0-8f10-b47f5fdc03cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:48 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Volume df6c115b-eda6-4ec0-bab2-5c6b8ea132ad: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad', 'volume_size': 1, 'source_volid': '5453c1de-03d9-49e1-8d07-d76d050b3b2c', 'source_volstatus': 'available'} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:48 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Cloning volume 5453c1de-03d9-49e1-8d07-d76d050b3b2c to volume df6c115b-eda6-4ec0-bab2-5c6b8ea132ad Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Creating offline snapshot 04302f68-99d9-43fd-b101-bb957d5a5568 of volume 5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[513a67b2-f994-4d3f-9386-5dbd7348d3de]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:48 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c Feb 27 22:30:48 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:49 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c" returned: 0 in 0.557s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:49 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 1G Feb 27 22:30:49 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:49 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 1G" returned: 0 in 0.471s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:49 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 Feb 27 22:30:49 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:50 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568" returned: 0 in 0.412s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:50 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 is being set with open permissions: ugo+rw Feb 27 22:30:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:50 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 Feb 27 22:30:50 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:50 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568" returned: 0 in 0.386s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:50 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.info Feb 27 22:30:50 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:50 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.info" returned: 0 in 0.401s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:50 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.info is being set with open permissions: ugo+rw Feb 27 22:30:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:50 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.info Feb 27 22:30:50 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:51 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.info" returned: 0 in 0.384s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] snapshot: 04302f68-99d9-43fd-b101-bb957d5a5568, volume: df6c115b-eda6-4ec0-bab2-5c6b8ea132ad, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72a7ca3-e931-461b-bf41-a0122dcdd7f9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:51 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 Feb 27 22:30:51 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:51 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568" returned: 0 in 0.467s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49485fd-ea04-4b0a-b6c5-d8d68dd38a21]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:51 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c Feb 27 22:30:51 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:52 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c" returned: 0 in 0.466s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:52 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:30:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:52 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad Feb 27 22:30:52 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:54 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" returned: 0 in 1.975s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:54 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c8c176-cd65-42f8-a332-6b352ae0e09a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:54 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c Feb 27 22:30:54 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:54 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c" returned: 0 in 0.614s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:54 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:30:54 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Converted 1024.00 MB image at 518.06 MB/s Feb 27 22:30:54 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad is being set with open permissions: ugo+rw Feb 27 22:30:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:54 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad Feb 27 22:30:54 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:55 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" returned: 0 in 0.391s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" released by "_copy_volume_from_snapshot" :: held 3.960s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-04302f68-99d9-43fd-b101-bb957d5a5568" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-04302f68-99d9-43fd-b101-bb957d5a5568" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Deleting offline snapshot 04302f68-99d9-43fd-b101-bb957d5a5568 of volume 5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] snapshot_file for this snap is: volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec2fd61-b6b4-4b5a-990c-026fe818b7e7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:55 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 Feb 27 22:30:55 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:55 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568" returned: 0 in 0.466s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[341abc32-6e00-422b-a059-be65924e4414]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:55 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c Feb 27 22:30:55 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:56 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c" returned: 0 in 0.456s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:56 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 Feb 27 22:30:56 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:56 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568" returned: 0 in 0.451s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:56 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568 Feb 27 22:30:56 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:57 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c.04302f68-99d9-43fd-b101-bb957d5a5568" returned: 0 in 0.417s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-04302f68-99d9-43fd-b101-bb957d5a5568" released by "_delete_snapshot" :: held 1.837s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.523s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f07f6a-7d77-4ba0-8f10-b47f5fdc03cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad', 'volume_size': 1, 'source_volid': '5453c1de-03d9-49e1-8d07-d76d050b3b2c', 'source_volstatus': 'available'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e68030-7b15-469e-b843-f57871e976da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:30:57 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Volume volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad (df6c115b-eda6-4ec0-bab2-5c6b8ea132ad): created successfully Feb 27 22:30:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e68030-7b15-469e-b843-f57871e976da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:30:57 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Flow 'volume_create_manager' (61122e69-8efd-4956-8dfd-66e5b571cf43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:30:57 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6496ca21-e681-40cc-b3e1-a52b857247da tempest-VolumeDependencyTests-2139820362 None] Created volume successfully. Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-5453c1de-03d9-49e1-8d07-d76d050b3b2c-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-5453c1de-03d9-49e1-8d07-d76d050b3b2c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-5453c1de-03d9-49e1-8d07-d76d050b3b2c" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-5453c1de-03d9-49e1-8d07-d76d050b3b2c" acquired by "delete_volume" :: waited 0.006s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1e3ca8-eee8-40e2-b434-a59bbd209a25]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:58 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c Feb 27 22:30:58 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:58 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c" returned: 0 in 0.468s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:58 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c Feb 27 22:30:58 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:58 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5453c1de-03d9-49e1-8d07-d76d050b3b2c" returned: 0 in 0.414s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-5453c1de-03d9-49e1-8d07-d76d050b3b2c" released by "delete_volume" :: held 0.912s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Created reservations ['349a0d1f-e7c2-4511-a3bc-bc41dddb819b', '32223d2e-38c1-45ed-bf0f-d1194fe09e05', '0a03b8c2-9d1f-4df6-8954-0a0df53548e3', '794e3962-9b89-4396-8d6a-283b390c6c1c'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:59 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:30:59 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" acquired by "delete_volume" :: waited 0.022s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f593a835-0abe-4eef-bea6-6d049ee6cd7d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:59 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad Feb 27 22:30:59 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:30:59 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.413s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:30:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Deleted volume successfully. Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f202fb51-3d7c-49ec-b5e5-e8714ca164c3 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-5453c1de-03d9-49e1-8d07-d76d050b3b2c-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:30:59 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" returned: 0 in 0.486s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:30:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:30:59 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad Feb 27 22:30:59 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:00 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" returned: 0 in 0.410s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad" released by "delete_volume" :: held 0.918s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Created reservations ['b3e7a351-8f8a-493c-a7a0-d0fee515c7f2', '4a031059-f136-4eaf-a4bb-87b20283a601', '3d2432ba-eb3c-4d3d-975b-fc8bd82d7774', 'f034df73-7158-43f6-a382-9ffb5ed5e99a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:00 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:31:00 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-c47884f6-9e1e-4893-9685-2b2b471cf3c7-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-c47884f6-9e1e-4893-9685-2b2b471cf3c7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "cinder-quobyte-c47884f6-9e1e-4893-9685-2b2b471cf3c7" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-c47884f6-9e1e-4893-9685-2b2b471cf3c7" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a7ef24-abf1-4a25-a5f2-854f4c47fcb2]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:00 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 Feb 27 22:31:00 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:00 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.423s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:31:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Deleted volume successfully. Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f083fd41-7161-4520-85a6-68c4f7aa105f tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-df6c115b-eda6-4ec0-bab2-5c6b8ea132ad-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:00 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7" returned: 0 in 0.486s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:00 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7 Feb 27 22:31:00 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:01 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c47884f6-9e1e-4893-9685-2b2b471cf3c7" returned: 0 in 0.400s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-quobyte-c47884f6-9e1e-4893-9685-2b2b471cf3c7" released by "delete_volume" :: held 0.908s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Created reservations ['c93fdfb0-3b47-494c-a61c-cc21093df740', 'c41c05c6-4a6e-4213-856d-a70b53850309', 'db8eea20-a8be-4484-9c1c-93588e3078b7', 'bf6ed9d1-3c22-4fdb-b0af-c8f58f1aa0c9'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:01 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:31:01 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:01 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.411s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:31:01 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Deleted volume successfully. Feb 27 22:31:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-1c52d6ce-905b-4910-ac3a-830a9f8b00d2 tempest-VolumeDependencyTests-2139820362 None] Lock "cinder-c47884f6-9e1e-4893-9685-2b2b471cf3c7-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:11 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=40,cinder:SELECT=36,cinder:DELETE=6,cinder:INSERT=13 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:31:11 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=179,cinder:SELECT=121,cinder:INSERT=43,cinder:DELETE=8 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Flow 'volume_create_manager' (af8207b2-2e99-4bb2-8bf1-19e91f0c28fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c66e29-8f51-4427-b5c8-92f56079b3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c66e29-8f51-4427-b5c8-92f56079b3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1887622511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fefe47b-d586-4bcb-93c2-d346552a5936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ce85c1ec884a7bb8b50ee7c4407fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:17Z,use_quota=True,user_id='19ff0ec01b3d412992d65d1e4da9f8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a94b65-81aa-4fb0-851d-cc7c2a4df622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a94b65-81aa-4fb0-851d-cc7c2a4df622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb0b0b9-a197-4e74-8fbf-43bbe0a67e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb0b0b9-a197-4e74-8fbf-43bbe0a67e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fefe47b-d586-4bcb-93c2-d346552a5936', 'volume_name': 'volume-1fefe47b-d586-4bcb-93c2-d346552a5936', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a85f24e-6da0-43c7-9fc2-3b319055d10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a85f24e-6da0-43c7-9fc2-3b319055d10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce25fae-9509-475f-a71d-2fa45790c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Volume 1fefe47b-d586-4bcb-93c2-d346552a5936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fefe47b-d586-4bcb-93c2-d346552a5936', 'volume_size': 1} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1887622511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fefe47b-d586-4bcb-93c2-d346552a5936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ce85c1ec884a7bb8b50ee7c4407fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:17Z,use_quota=True,user_id='19ff0ec01b3d412992d65d1e4da9f8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Creating volume 1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:17 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:17 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 1073741824 Feb 27 22:31:17 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:17 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 1073741824" returned: 0 in 0.475s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:17 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 Feb 27 22:31:17 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:18 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936" returned: 0 in 0.394s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:18 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce25fae-9509-475f-a71d-2fa45790c79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fefe47b-d586-4bcb-93c2-d346552a5936', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00fdfae-8d74-426b-ba52-6525da52b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:18 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Volume volume-1fefe47b-d586-4bcb-93c2-d346552a5936 (1fefe47b-d586-4bcb-93c2-d346552a5936): created successfully Feb 27 22:31:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00fdfae-8d74-426b-ba52-6525da52b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Flow 'volume_create_manager' (af8207b2-2e99-4bb2-8bf1-19e91f0c28fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:18 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d96700fe-23ad-4bfd-abca-7aa1cdafaf3e tempest-SnapshotDependencyTests-1638010325 None] Created volume successfully. Feb 27 22:31:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:19 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Creating offline snapshot 75efdede-cdcb-4fec-a45c-9e25ce0f1e79 of volume 1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:31:19 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d49a7b6-b727-407d-a5b3-1c2bbff88eaa]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:19 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 Feb 27 22:31:19 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:19 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936" returned: 0 in 0.469s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:19 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 1G Feb 27 22:31:19 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:20 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 1G" returned: 0 in 0.453s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fefe47b-d586-4bcb-93c2-d346552a5936 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:20 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fefe47b-d586-4bcb-93c2-d346552a5936 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 Feb 27 22:31:20 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:20 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fefe47b-d586-4bcb-93c2-d346552a5936 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79" returned: 0 in 0.418s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:20 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 is being set with open permissions: ugo+rw Feb 27 22:31:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:20 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 Feb 27 22:31:20 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:21 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79" returned: 0 in 0.392s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:21 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.info Feb 27 22:31:21 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:21 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.info" returned: 0 in 0.404s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:21 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.info is being set with open permissions: ugo+rw Feb 27 22:31:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:21 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.info Feb 27 22:31:21 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:21 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.info" returned: 0 in 0.413s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.608s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:21 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-19ded5f5-4275-42c0-ad9b-08559d4cd01e tempest-SnapshotDependencyTests-1638010325 None] Create snapshot completed successfully Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Flow 'volume_create_manager' (d0e6601e-9751-4198-9c35-76d219cdb108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb786bc-ac93-433e-972a-f83da422f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb786bc-ac93-433e-972a-f83da422f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232be6c8-9d84-4c84-add7-fb659615bdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ce85c1ec884a7bb8b50ee7c4407fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75efdede-cdcb-4fec-a45c-9e25ce0f1e79,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:23Z,use_quota=True,user_id='19ff0ec01b3d412992d65d1e4da9f8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151b2aee-8985-4905-90c5-dfe20c37a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151b2aee-8985-4905-90c5-dfe20c37a43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75cc5ed-742c-42a6-a3c3-2e1be28ba1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75cc5ed-742c-42a6-a3c3-2e1be28ba1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '232be6c8-9d84-4c84-add7-fb659615bdb6', 'volume_name': 'volume-232be6c8-9d84-4c84-add7-fb659615bdb6', 'volume_size': 1, 'snapshot_id': '75efdede-cdcb-4fec-a45c-9e25ce0f1e79'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f391a66-339f-40dc-a134-0ecc8709d36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f391a66-339f-40dc-a134-0ecc8709d36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09f98c3-04e0-4f15-89f7-960ab56d124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:22 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Volume 232be6c8-9d84-4c84-add7-fb659615bdb6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-232be6c8-9d84-4c84-add7-fb659615bdb6', 'volume_size': 1, 'snapshot_id': '75efdede-cdcb-4fec-a45c-9e25ce0f1e79'} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-quobyte-75efdede-cdcb-4fec-a45c-9e25ce0f1e79-232be6c8-9d84-4c84-add7-fb659615bdb6" by "_create_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-75efdede-cdcb-4fec-a45c-9e25ce0f1e79-232be6c8-9d84-4c84-add7-fb659615bdb6" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Creating volume 232be6c8-9d84-4c84-add7-fb659615bdb6 from snapshot 75efdede-cdcb-4fec-a45c-9e25ce0f1e79 {{(pid=83540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-quobyte-232be6c8-9d84-4c84-add7-fb659615bdb6" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-232be6c8-9d84-4c84-add7-fb659615bdb6" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] snapshot: 75efdede-cdcb-4fec-a45c-9e25ce0f1e79, volume: 232be6c8-9d84-4c84-add7-fb659615bdb6, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[641f6c28-31f6-4239-857c-5018485437e9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:22 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 Feb 27 22:31:22 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:23 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79" returned: 0 in 0.458s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fefe47b-d586-4bcb-93c2-d346552a5936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10a3e05-8bff-46af-9456-544ea1190229]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:23 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 Feb 27 22:31:23 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:23 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936" returned: 0 in 0.500s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:31:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:23 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 Feb 27 22:31:23 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:25 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6" returned: 0 in 1.992s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:25 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d92ae2-f7b7-4820-9789-bcd774770daa]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:25 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 Feb 27 22:31:25 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:26 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936" returned: 0 in 0.578s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:31:26 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Converted 1024.00 MB image at 513.82 MB/s Feb 27 22:31:26 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 is being set with open permissions: ugo+rw Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:26 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 Feb 27 22:31:26 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:26 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6" returned: 0 in 0.435s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-232be6c8-9d84-4c84-add7-fb659615bdb6" released by "_copy_volume_from_snapshot" :: held 4.017s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-75efdede-cdcb-4fec-a45c-9e25ce0f1e79-232be6c8-9d84-4c84-add7-fb659615bdb6" released by "_create_volume_from_snapshot" :: held 4.032s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.041s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09f98c3-04e0-4f15-89f7-960ab56d124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232be6c8-9d84-4c84-add7-fb659615bdb6', 'volume_size': 1, 'snapshot_id': '75efdede-cdcb-4fec-a45c-9e25ce0f1e79'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf20cdf9-c17c-4a56-bbca-919e3c1bfe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:26 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Volume volume-232be6c8-9d84-4c84-add7-fb659615bdb6 (232be6c8-9d84-4c84-add7-fb659615bdb6): created successfully Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf20cdf9-c17c-4a56-bbca-919e3c1bfe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:26 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Flow 'volume_create_manager' (d0e6601e-9751-4198-9c35-76d219cdb108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:26 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-42eb7a55-3ebb-4bdd-9a58-672a7dbc0649 tempest-SnapshotDependencyTests-1638010325 None] Created volume successfully. Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-75efdede-cdcb-4fec-a45c-9e25ce0f1e79-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-75efdede-cdcb-4fec-a45c-9e25ce0f1e79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-quobyte-1fefe47b-d586-4bcb-93c2-d346552a5936" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-1fefe47b-d586-4bcb-93c2-d346552a5936" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-quobyte-75efdede-cdcb-4fec-a45c-9e25ce0f1e79" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-75efdede-cdcb-4fec-a45c-9e25ce0f1e79" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Deleting offline snapshot 75efdede-cdcb-4fec-a45c-9e25ce0f1e79 of volume 1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] snapshot_file for this snap is: volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9dccd-adf2-4645-b37d-64dbe9fb368b]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:27 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 Feb 27 22:31:27 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:27 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79" returned: 0 in 0.481s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fefe47b-d586-4bcb-93c2-d346552a5936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[564b1e30-4207-4771-8286-1e49692663b9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:27 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 Feb 27 22:31:27 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:28 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936" returned: 0 in 0.494s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:28 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 Feb 27 22:31:28 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:28 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79" returned: 0 in 0.433s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:28 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79 Feb 27 22:31:28 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:28 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936.75efdede-cdcb-4fec-a45c-9e25ce0f1e79" returned: 0 in 0.415s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-75efdede-cdcb-4fec-a45c-9e25ce0f1e79" released by "_delete_snapshot" :: held 1.880s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-1fefe47b-d586-4bcb-93c2-d346552a5936" released by "delete_snapshot" :: held 1.892s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:28 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Created reservations ['df2b34fc-2f94-4849-9a71-729db687c774', '7a8e1c0e-b3ce-4a7c-ab4d-929a292a506b', '09791fe2-1fd3-41c3-8dfd-1847447e5969', 'f43cda47-0af2-49f2-90dd-11bef510e8e8'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:31:28 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Delete snapshot completed successfully. Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-d4ebbe8e-7f35-434a-887f-223bdaa023e7 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-75efdede-cdcb-4fec-a45c-9e25ce0f1e79-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-1fefe47b-d586-4bcb-93c2-d346552a5936-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-1fefe47b-d586-4bcb-93c2-d346552a5936-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-quobyte-1fefe47b-d586-4bcb-93c2-d346552a5936" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-1fefe47b-d586-4bcb-93c2-d346552a5936" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc0ac33-cc9e-480c-a4b1-2cf8a3b93f5f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:29 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 Feb 27 22:31:29 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:29 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936" returned: 0 in 0.454s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:29 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936 Feb 27 22:31:29 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:30 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-1fefe47b-d586-4bcb-93c2-d346552a5936" returned: 0 in 0.381s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-1fefe47b-d586-4bcb-93c2-d346552a5936" released by "delete_volume" :: held 0.866s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Created reservations ['f8dbb010-e7df-48b3-8639-7603d36f0bc0', '5c18105a-db81-4b87-b4dd-31fe513c05fc', '9bd46584-b781-4fe6-9686-618895ae0311', 'ba057ae0-7d11-4322-b711-bf4a463478c5'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:30 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:31:30 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-232be6c8-9d84-4c84-add7-fb659615bdb6-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-232be6c8-9d84-4c84-add7-fb659615bdb6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "cinder-quobyte-232be6c8-9d84-4c84-add7-fb659615bdb6" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-232be6c8-9d84-4c84-add7-fb659615bdb6" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb18966-b181-4591-a1da-09aef662e5b7]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:30 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 Feb 27 22:31:30 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:30 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.448s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:31:30 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Deleted volume successfully. Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-93762c5a-bcf0-4b95-9430-43bd0436a5fa tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-1fefe47b-d586-4bcb-93c2-d346552a5936-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:30 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6" returned: 0 in 0.492s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:30 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6 Feb 27 22:31:30 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:31 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-232be6c8-9d84-4c84-add7-fb659615bdb6" returned: 0 in 0.398s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-quobyte-232be6c8-9d84-4c84-add7-fb659615bdb6" released by "delete_volume" :: held 0.929s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Created reservations ['e1bb777d-bacd-4a28-be5a-ea4f895d7f35', 'c34a42d5-df36-4896-819b-4e2153bdfa13', 'fe23f301-d215-4247-8ac8-c4afc7448a52', '055dfa9f-479e-4eb2-b2ae-585d0b9cf707'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:31 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:31:31 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:31 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.434s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:31:31 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Deleted volume successfully. Feb 27 22:31:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-dd6f6b18-6bcd-48c5-8253-cce9cf2b2be6 tempest-SnapshotDependencyTests-1638010325 None] Lock "cinder-232be6c8-9d84-4c84-add7-fb659615bdb6-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:31:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:40 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:31:40 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:41 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=7 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:31:41 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.456s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:31:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:31:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:31:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:31:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:31:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:31:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:31:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:31:41 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=34,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=4 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Flow 'volume_create_manager' (92cbc197-f9a6-4ae5-a989-bc528ee16e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3debfa-d843-46c7-9f30-cd70131ced11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (de5f411f-f183-4e19-92bf-8e7b535f2569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11f92ca-aa52-4c92-99e5-c0a768dbea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3debfa-d843-46c7-9f30-cd70131ced11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1344659874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38070ced-f6e0-46a8-a83b-8be0c3f0a321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1b1ab7a359436a93f6f4ff7c8a1b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:44Z,use_quota=True,user_id='9094a6113b6a404682259bc03877761d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001a3472-1f6b-4bf8-921a-681e5290db69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001a3472-1f6b-4bf8-921a-681e5290db69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbcf83b1-a794-4829-869c-dc0f39a096b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbcf83b1-a794-4829-869c-dc0f39a096b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38070ced-f6e0-46a8-a83b-8be0c3f0a321', 'volume_name': 'volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb602ffa-d2aa-4efd-9572-8ad902868556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb602ffa-d2aa-4efd-9572-8ad902868556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef4648f-a6f9-4a2e-ab34-cd2afb6cda47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Volume 38070ced-f6e0-46a8-a83b-8be0c3f0a321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321', 'volume_size': 1} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1344659874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38070ced-f6e0-46a8-a83b-8be0c3f0a321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1b1ab7a359436a93f6f4ff7c8a1b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:44Z,use_quota=True,user_id='9094a6113b6a404682259bc03877761d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Creating volume 38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:44 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:44 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 1073741824 Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11f92ca-aa52-4c92-99e5-c0a768dbea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2067784951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4884fa8-e782-4452-932d-3982956c6ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:44Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d50bd7b-3232-4ed5-a8de-3080ca026a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d50bd7b-3232-4ed5-a8de-3080ca026a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b63255-414d-4752-819a-9fa008a23b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b63255-414d-4752-819a-9fa008a23b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4884fa8-e782-4452-932d-3982956c6ae7', 'volume_name': 'volume-a4884fa8-e782-4452-932d-3982956c6ae7', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5941a9f0-0270-4930-a60b-98bfadddbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5941a9f0-0270-4930-a60b-98bfadddbf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2937bfc2-eb38-44e9-b2e0-851807197e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume a4884fa8-e782-4452-932d-3982956c6ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4884fa8-e782-4452-932d-3982956c6ae7', 'volume_size': 1} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (54d0873e-9946-45bf-b14f-b7899fac7e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed5873c-428c-458b-8850-e0e81a2bc31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed5873c-428c-458b-8850-e0e81a2bc31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1777313111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819b734f-98ac-4a3d-8b91-222a94757c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:44Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1e457a-ae83-4b6c-b7ee-19e03c3e2e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1e457a-ae83-4b6c-b7ee-19e03c3e2e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9636822b-832f-4eca-a954-6cf071d1ec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9636822b-832f-4eca-a954-6cf071d1ec06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819b734f-98ac-4a3d-8b91-222a94757c80', 'volume_name': 'volume-819b734f-98ac-4a3d-8b91-222a94757c80', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac613ab8-c654-44ac-b295-5a93a364b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac613ab8-c654-44ac-b295-5a93a364b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69e098a-429c-47b9-bfd3-14d4db567486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Volume 819b734f-98ac-4a3d-8b91-222a94757c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819b734f-98ac-4a3d-8b91-222a94757c80', 'volume_size': 1} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (f6095c1a-b976-4f72-88d8-6ce843574392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbadb679-4554-483c-a27b-062c2aa97d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbadb679-4554-483c-a27b-062c2aa97d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847056347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0df216-9256-4df7-9d59-0a18997ee40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:44Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdf1cc3-a0d2-4f77-bc2c-1a098c8f997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdf1cc3-a0d2-4f77-bc2c-1a098c8f997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563011e0-3a7d-4229-926b-57b33cd4f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563011e0-3a7d-4229-926b-57b33cd4f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0df216-9256-4df7-9d59-0a18997ee40a', 'volume_name': 'volume-ee0df216-9256-4df7-9d59-0a18997ee40a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e4e4b2-7f87-4421-ae0e-3bcdcd6ffbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e4e4b2-7f87-4421-ae0e-3bcdcd6ffbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4b9651-411b-4751-8f43-d5654cef3a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Volume ee0df216-9256-4df7-9d59-0a18997ee40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0df216-9256-4df7-9d59-0a18997ee40a', 'volume_size': 1} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (f90c1ffb-fa9b-4a9b-847b-d2b58ea3114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df63d2b9-e262-4042-85f1-1acbeff7f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df63d2b9-e262-4042-85f1-1acbeff7f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-973768477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae91ef6-07eb-45e5-a204-eeacb071e0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:45Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8be2ec1-d6af-4db6-ae8e-ff765e639040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8be2ec1-d6af-4db6-ae8e-ff765e639040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6d3485-9407-441a-8a24-8b0df0905ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6d3485-9407-441a-8a24-8b0df0905ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae91ef6-07eb-45e5-a204-eeacb071e0ac', 'volume_name': 'volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fb7fd8-6957-436a-86c8-3e6578a82a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fb7fd8-6957-436a-86c8-3e6578a82a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3989549-da7c-4317-9ede-3d60d92e4973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:44 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Volume cae91ef6-07eb-45e5-a204-eeacb071e0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac', 'volume_size': 1} Feb 27 22:31:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (98db3be9-4827-4929-8e5f-9e093805c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0013ab-802b-41f3-b222-616cc78fc431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0013ab-802b-41f3-b222-616cc78fc431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497343914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875730f0-8957-4f9e-8b78-ff32aca51107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:45Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416b28c2-b93b-4299-8f52-e5287a3674cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416b28c2-b93b-4299-8f52-e5287a3674cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74463be6-82e1-4fdc-82ab-cd5c91079354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74463be6-82e1-4fdc-82ab-cd5c91079354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875730f0-8957-4f9e-8b78-ff32aca51107', 'volume_name': 'volume-875730f0-8957-4f9e-8b78-ff32aca51107', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e82b3f-cb0a-4b53-94f5-61a1853db9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e82b3f-cb0a-4b53-94f5-61a1853db9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d2187a-3f79-4195-9da1-3ff0c627e367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Volume 875730f0-8957-4f9e-8b78-ff32aca51107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875730f0-8957-4f9e-8b78-ff32aca51107', 'volume_size': 1} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 1073741824" returned: 0 in 0.765s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:45 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 Feb 27 22:31:45 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (80eae8e5-5944-45fa-8178-8447a8a70024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872fa7a3-5b05-4881-89f3-5717062cd632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872fa7a3-5b05-4881-89f3-5717062cd632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850596004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8f93de-8969-4a7b-a5fa-00774c674a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:45Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfdd246-cfe5-40c3-a7f0-cd7031916e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfdd246-cfe5-40c3-a7f0-cd7031916e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47245a18-8229-484d-9354-81debb9a8d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47245a18-8229-484d-9354-81debb9a8d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8f93de-8969-4a7b-a5fa-00774c674a22', 'volume_name': 'volume-5e8f93de-8969-4a7b-a5fa-00774c674a22', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8a23b2-4776-4008-8432-b91c7b0d2e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8a23b2-4776-4008-8432-b91c7b0d2e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58594c1-a5b7-403d-82b6-752136cf994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Volume 5e8f93de-8969-4a7b-a5fa-00774c674a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8f93de-8969-4a7b-a5fa-00774c674a22', 'volume_size': 1} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:45 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2067784951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4884fa8-e782-4452-932d-3982956c6ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:44Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Creating volume a4884fa8-e782-4452-932d-3982956c6ae7 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:45 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef4648f-a6f9-4a2e-ab34-cd2afb6cda47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 1073741824 Feb 27 22:31:45 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99950c0-53d8-44bd-9f79-62cb98bcae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:45 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Volume volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 (38070ced-f6e0-46a8-a83b-8be0c3f0a321): created successfully Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99950c0-53d8-44bd-9f79-62cb98bcae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:45 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Flow 'volume_create_manager' (92cbc197-f9a6-4ae5-a989-bc528ee16e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:45 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-73b92a6f-cfe5-498d-994c-71c150d1530a tempest-VolumeDependencyTests-522888339 None] Created volume successfully. Feb 27 22:31:46 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 1073741824" returned: 0 in 0.490s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:46 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 Feb 27 22:31:46 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:46 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7" returned: 0 in 0.479s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.109s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1777313111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819b734f-98ac-4a3d-8b91-222a94757c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:44Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Creating volume 819b734f-98ac-4a3d-8b91-222a94757c80 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:46 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2937bfc2-eb38-44e9-b2e0-851807197e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4884fa8-e782-4452-932d-3982956c6ae7', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17edec00-8f0a-4270-9e39-993648f045ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:46 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 1073741824 Feb 27 22:31:46 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:46 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume volume-a4884fa8-e782-4452-932d-3982956c6ae7 (a4884fa8-e782-4452-932d-3982956c6ae7): created successfully Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17edec00-8f0a-4270-9e39-993648f045ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:46 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (de5f411f-f183-4e19-92bf-8e7b535f2569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:46 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a8797f58-cff5-42a7-a2b5-e19451fd0668 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created volume successfully. Feb 27 22:31:47 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 1073741824" returned: 0 in 0.549s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:47 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 Feb 27 22:31:47 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (2b7ca226-7eaa-41c9-b25b-b8ad687a4620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b1f657-94e8-4b4e-a700-580e9a91d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b1f657-94e8-4b4e-a700-580e9a91d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594895755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a949da8d-0288-472a-a65d-ef2736da449e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:48Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e75b81f-511c-46c1-92d8-c70333f246ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e75b81f-511c-46c1-92d8-c70333f246ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8265298-a835-4ea2-85cb-108b34bb7797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8265298-a835-4ea2-85cb-108b34bb7797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a949da8d-0288-472a-a65d-ef2736da449e', 'volume_name': 'volume-a949da8d-0288-472a-a65d-ef2736da449e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2612b4d-d7e7-406b-bd02-d47b08ff3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2612b4d-d7e7-406b-bd02-d47b08ff3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26bbfae-66bb-4212-af99-ebb3c05ead61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume a949da8d-0288-472a-a65d-ef2736da449e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a949da8d-0288-472a-a65d-ef2736da449e', 'volume_size': 1} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:47 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80" returned: 0 in 0.519s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.125s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847056347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0df216-9256-4df7-9d59-0a18997ee40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:44Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Creating volume ee0df216-9256-4df7-9d59-0a18997ee40a {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:47 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69e098a-429c-47b9-bfd3-14d4db567486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819b734f-98ac-4a3d-8b91-222a94757c80', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc8b7cc-fea4-4745-b46e-361f262af9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a 1073741824 Feb 27 22:31:47 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:47 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Volume volume-819b734f-98ac-4a3d-8b91-222a94757c80 (819b734f-98ac-4a3d-8b91-222a94757c80): created successfully Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc8b7cc-fea4-4745-b46e-361f262af9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (54d0873e-9946-45bf-b14f-b7899fac7e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (90c68af2-6f7f-466d-91bf-8342985c513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00637f4e-f2bb-434b-a5a2-4d1d2f6c12ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00637f4e-f2bb-434b-a5a2-4d1d2f6c12ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258358172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d4087e-ce41-4610-8864-bca8bd16fc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:48Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262d6dab-7c4b-489b-957b-e7aa99502746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262d6dab-7c4b-489b-957b-e7aa99502746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299fbcfe-63e2-41a2-86e5-cd3637fc6f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299fbcfe-63e2-41a2-86e5-cd3637fc6f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d4087e-ce41-4610-8864-bca8bd16fc40', 'volume_name': 'volume-e2d4087e-ce41-4610-8864-bca8bd16fc40', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31765f82-0396-4fb4-902e-e7be87a24f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31765f82-0396-4fb4-902e-e7be87a24f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e6e103-94bc-42b6-9005-da7419de76d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:47 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume e2d4087e-ce41-4610-8864-bca8bd16fc40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d4087e-ce41-4610-8864-bca8bd16fc40', 'volume_size': 1} Feb 27 22:31:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:47 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f18ebe47-db9c-4407-8dd2-6d126141e198 tempest-CreateVolumesFromImageTest-1951364129 None] Created volume successfully. Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (298d451b-e63c-46f2-ae68-80731e5a4477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e58adb8-2eee-42b9-83ea-840ccaf048f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e58adb8-2eee-42b9-83ea-840ccaf048f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1958499170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392cf24e-66e4-4cc6-ae43-b8621fcd7274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:48Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fb8d83-11fc-4042-b06b-80f1c7cbc519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fb8d83-11fc-4042-b06b-80f1c7cbc519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a7b67f-a2c4-497d-9fa9-be802327e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a7b67f-a2c4-497d-9fa9-be802327e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392cf24e-66e4-4cc6-ae43-b8621fcd7274', 'volume_name': 'volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42ea53c-68ad-4186-ac0d-2ed22c4441af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42ea53c-68ad-4186-ac0d-2ed22c4441af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acf5ec3-dc37-4df5-aa23-5a312273823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume 392cf24e-66e4-4cc6-ae43-b8621fcd7274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274', 'volume_size': 1} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (21d5351c-1184-4d7f-8436-229117814bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c78d62-3bc9-4694-897e-7340bc2d9c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c78d62-3bc9-4694-897e-7340bc2d9c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669323334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2896651-a3ff-477c-a046-6004cf0e93a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:48Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ebd164-31b0-4b06-86a7-bb720a496ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ebd164-31b0-4b06-86a7-bb720a496ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c16713-e9f0-4149-bb12-bfb03e674a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c16713-e9f0-4149-bb12-bfb03e674a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2896651-a3ff-477c-a046-6004cf0e93a8', 'volume_name': 'volume-b2896651-a3ff-477c-a046-6004cf0e93a8', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efa5930-a4e1-42b7-99ce-7b2b6c32f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efa5930-a4e1-42b7-99ce-7b2b6c32f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517e0bcd-9c58-442d-bf26-efb381e3efa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume b2896651-a3ff-477c-a046-6004cf0e93a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2896651-a3ff-477c-a046-6004cf0e93a8', 'volume_size': 1} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:48 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a 1073741824" returned: 0 in 0.692s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:48 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a Feb 27 22:31:48 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (ba7aae36-6466-4f29-ac96-fdf8f3ec7d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fdea4eb-ec47-444f-a8c5-6e5354466e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fdea4eb-ec47-444f-a8c5-6e5354466e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117714003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3ddb3d-76df-46cc-bacf-564560d454f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:49Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e4127c-d977-4405-9598-f6ca5bdc240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e4127c-d977-4405-9598-f6ca5bdc240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515dae74-73cf-4fbd-98b1-41a38f6759b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515dae74-73cf-4fbd-98b1-41a38f6759b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3ddb3d-76df-46cc-bacf-564560d454f9', 'volume_name': 'volume-ff3ddb3d-76df-46cc-bacf-564560d454f9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7945673b-9c1d-4096-aa03-bab741ff9cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7945673b-9c1d-4096-aa03-bab741ff9cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04318129-33d7-49b1-9226-5285f0e2444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume ff3ddb3d-76df-46cc-bacf-564560d454f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3ddb3d-76df-46cc-bacf-564560d454f9', 'volume_size': 1} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:48 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a" returned: 0 in 0.458s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.019s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-973768477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae91ef6-07eb-45e5-a204-eeacb071e0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:45Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Creating volume cae91ef6-07eb-45e5-a204-eeacb071e0ac {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:48 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4b9651-411b-4751-8f43-d5654cef3a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0df216-9256-4df7-9d59-0a18997ee40a', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83b117b-6e70-4e8e-8197-920f5000bf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:48 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac 1073741824 Feb 27 22:31:48 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:48 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Volume volume-ee0df216-9256-4df7-9d59-0a18997ee40a (ee0df216-9256-4df7-9d59-0a18997ee40a): created successfully Feb 27 22:31:48 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83b117b-6e70-4e8e-8197-920f5000bf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:49 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (f6095c1a-b976-4f72-88d8-6ce843574392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:49 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-e6bf595e-39c4-40ac-972f-14d8342a97c2 tempest-CreateVolumesFromImageTest-1951364129 None] Created volume successfully. Feb 27 22:31:49 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac 1073741824" returned: 0 in 0.575s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:49 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac Feb 27 22:31:49 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:50 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac" returned: 0 in 0.453s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.873s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497343914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875730f0-8957-4f9e-8b78-ff32aca51107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:45Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Creating volume 875730f0-8957-4f9e-8b78-ff32aca51107 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:50 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3989549-da7c-4317-9ede-3d60d92e4973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962fbf05-c759-4259-9883-21b367650be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:50 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 1073741824 Feb 27 22:31:50 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:50 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Volume volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac (cae91ef6-07eb-45e5-a204-eeacb071e0ac): created successfully Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962fbf05-c759-4259-9883-21b367650be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (f90c1ffb-fa9b-4a9b-847b-d2b58ea3114a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:50 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-28b20a84-c40c-487d-b749-bc645649d14e tempest-CreateVolumesFromImageTest-1951364129 None] Created volume successfully. Feb 27 22:31:50 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 1073741824" returned: 0 in 0.554s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:50 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:50 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 Feb 27 22:31:50 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:51 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107" returned: 0 in 0.541s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.828s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850596004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8f93de-8969-4a7b-a5fa-00774c674a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597b2e9f5e64b1e86afed7d48dc6399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:45Z,use_quota=True,user_id='80a17685705847faa102b0db1f4cd3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Creating volume 5e8f93de-8969-4a7b-a5fa-00774c674a22 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:51 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d2187a-3f79-4195-9da1-3ff0c627e367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875730f0-8957-4f9e-8b78-ff32aca51107', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:51 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 1073741824 Feb 27 22:31:51 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49eabab2-b745-4c3f-9563-5fe457fc6613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:51 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Volume volume-875730f0-8957-4f9e-8b78-ff32aca51107 (875730f0-8957-4f9e-8b78-ff32aca51107): created successfully Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49eabab2-b745-4c3f-9563-5fe457fc6613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (98db3be9-4827-4929-8e5f-9e093805c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:51 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1a87c926-32ff-4f16-a191-daae383afa72 tempest-CreateVolumesFromImageTest-1951364129 None] Created volume successfully. Feb 27 22:31:51 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 1073741824" returned: 0 in 0.538s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:51 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:51 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 Feb 27 22:31:51 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:52 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22" returned: 0 in 0.454s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.932s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58594c1-a5b7-403d-82b6-752136cf994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8f93de-8969-4a7b-a5fa-00774c674a22', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93840d76-e5ea-4eca-b439-56c69808342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:52 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Volume volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 (5e8f93de-8969-4a7b-a5fa-00774c674a22): created successfully Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93840d76-e5ea-4eca-b439-56c69808342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Flow 'volume_create_manager' (80eae8e5-5944-45fa-8178-8447a8a70024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Creating offline snapshot 0bcdd2de-381a-4dab-893f-5bd62c9c08f5 of volume 38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:31:52 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-453a1439-0334-4dcd-9c28-4360cfc6b916 tempest-CreateVolumesFromImageTest-1951364129 None] Created volume successfully. Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a77a73-e385-40b5-80df-9ad41fbd384d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:52 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 Feb 27 22:31:52 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:52 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321" returned: 0 in 0.548s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:52 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 1G Feb 27 22:31:52 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-5e8f93de-8969-4a7b-a5fa-00774c674a22-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-5e8f93de-8969-4a7b-a5fa-00774c674a22-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-quobyte-5e8f93de-8969-4a7b-a5fa-00774c674a22" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:52 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-5e8f93de-8969-4a7b-a5fa-00774c674a22" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:53 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2d999-5523-4786-9463-652ff5fff119]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:53 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 Feb 27 22:31:53 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:53 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 1G" returned: 0 in 0.580s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:53 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 Feb 27 22:31:53 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:53 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22" returned: 0 in 0.550s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:53 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22 Feb 27 22:31:53 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:53 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5" returned: 0 in 0.531s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:53 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 is being set with open permissions: ugo+rw Feb 27 22:31:53 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:53 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 Feb 27 22:31:53 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:54 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-5e8f93de-8969-4a7b-a5fa-00774c674a22" returned: 0 in 0.533s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-5e8f93de-8969-4a7b-a5fa-00774c674a22" released by "delete_volume" :: held 1.106s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Created reservations ['7590827a-5448-47dd-98ba-27f1111ec654', 'aa2c3ab7-9578-4eb6-8dd1-3a6e25d1b26d', 'd53050ef-8426-4d23-987c-0be135b47553', '6f6547dd-c1db-4587-ae51-ebe5fd5ce4f5'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:54 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:31:54 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:54 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5" returned: 0 in 0.499s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:54 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.info Feb 27 22:31:54 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:54 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.431s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:31:54 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Deleted volume successfully. Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-af17025a-df06-443a-96ee-9f7f09efdc4c tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-5e8f93de-8969-4a7b-a5fa-00774c674a22-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:54 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.info" returned: 0 in 0.462s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:54 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.info is being set with open permissions: ugo+rw Feb 27 22:31:54 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:54 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.info Feb 27 22:31:54 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-875730f0-8957-4f9e-8b78-ff32aca51107-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-875730f0-8957-4f9e-8b78-ff32aca51107-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-quobyte-875730f0-8957-4f9e-8b78-ff32aca51107" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-875730f0-8957-4f9e-8b78-ff32aca51107" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d31c3e-40e8-45af-b214-4cc352870e83]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:55 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 Feb 27 22:31:55 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:55 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.info" returned: 0 in 0.539s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.253s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.829s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594895755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a949da8d-0288-472a-a65d-ef2736da449e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:48Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Creating volume a949da8d-0288-472a-a65d-ef2736da449e {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:55 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:55 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a78ad2b8-0453-481e-8b0b-e3cbb2b82b54 tempest-VolumeDependencyTests-522888339 None] Create snapshot completed successfully Feb 27 22:31:55 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e 1073741824 Feb 27 22:31:55 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:55 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107" returned: 0 in 0.787s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:55 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:56 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107 Feb 27 22:31:56 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Flow 'volume_create_manager' (f7ed7940-4878-4c12-99d2-646d77570209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee5b53d-4f2b-4b36-840e-02811f578c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee5b53d-4f2b-4b36-840e-02811f578c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2134381551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f5abed-4708-4087-be38-961beea9f1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1b1ab7a359436a93f6f4ff7c8a1b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0bcdd2de-381a-4dab-893f-5bd62c9c08f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:56Z,use_quota=True,user_id='9094a6113b6a404682259bc03877761d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d542fcd6-a677-4f07-9e4a-1064e8f9d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d542fcd6-a677-4f07-9e4a-1064e8f9d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb27fb7-0049-43b2-8b7f-8987d0799603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb27fb7-0049-43b2-8b7f-8987d0799603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5f5abed-4708-4087-be38-961beea9f1f9', 'volume_name': 'volume-c5f5abed-4708-4087-be38-961beea9f1f9', 'volume_size': 1, 'snapshot_id': '0bcdd2de-381a-4dab-893f-5bd62c9c08f5'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63f15ca-a2b8-4290-a394-450e8b47d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63f15ca-a2b8-4290-a394-450e8b47d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b92472-5502-4246-b957-c56fb54a242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:56 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Volume c5f5abed-4708-4087-be38-961beea9f1f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5f5abed-4708-4087-be38-961beea9f1f9', 'volume_size': 1, 'snapshot_id': '0bcdd2de-381a-4dab-893f-5bd62c9c08f5'} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:56 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e 1073741824" returned: 0 in 0.904s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:56 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e Feb 27 22:31:56 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:56 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-875730f0-8957-4f9e-8b78-ff32aca51107" returned: 0 in 0.603s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-875730f0-8957-4f9e-8b78-ff32aca51107" released by "delete_volume" :: held 1.432s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Created reservations ['d33d704d-de03-4522-bb45-b1fc7659cb57', 'ed9f8b53-080d-4abd-bd4a-9fc722150af1', '58b7c6d9-a33f-4ab5-b67d-134562f6d5c1', '4b2e639b-85ba-40af-93c5-b1594927ec99'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:56 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:31:56 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:56 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e" returned: 0 in 0.489s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.940s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258358172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d4087e-ce41-4610-8864-bca8bd16fc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:48Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Creating volume e2d4087e-ce41-4610-8864-bca8bd16fc40 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:56 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26bbfae-66bb-4212-af99-ebb3c05ead61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a949da8d-0288-472a-a65d-ef2736da449e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99e49d9-f6f3-41fc-9e45-83ae6112c73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:56 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume volume-a949da8d-0288-472a-a65d-ef2736da449e (a949da8d-0288-472a-a65d-ef2736da449e): created successfully Feb 27 22:31:56 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 1073741824 Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99e49d9-f6f3-41fc-9e45-83ae6112c73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:56 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:56 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (2b7ca226-7eaa-41c9-b25b-b8ad687a4620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:56 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-6253fe10-8d03-4a98-889f-795d1e03415c tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created volume successfully. Feb 27 22:31:57 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.517s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:31:57 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Deleted volume successfully. Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3dfb5667-9fde-488c-86b7-a5ece394e304 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-875730f0-8957-4f9e-8b78-ff32aca51107-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-cae91ef6-07eb-45e5-a204-eeacb071e0ac-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-cae91ef6-07eb-45e5-a204-eeacb071e0ac-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-quobyte-cae91ef6-07eb-45e5-a204-eeacb071e0ac" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-cae91ef6-07eb-45e5-a204-eeacb071e0ac" acquired by "delete_volume" :: waited 0.014s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[986b4da3-49a6-4fba-962b-dc6859d59ea9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:57 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac Feb 27 22:31:57 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:57 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 1073741824" returned: 0 in 0.642s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:57 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:57 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 Feb 27 22:31:57 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:58 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac" returned: 0 in 0.661s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:58 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:58 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac Feb 27 22:31:58 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.944s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1958499170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392cf24e-66e4-4cc6-ae43-b8621fcd7274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:48Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Creating volume 392cf24e-66e4-4cc6-ae43-b8621fcd7274 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:58 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e6e103-94bc-42b6-9005-da7419de76d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d4087e-ce41-4610-8864-bca8bd16fc40', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3c8431-a01e-48b0-ba08-0dc050bd9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:58 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 1073741824 Feb 27 22:31:58 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:58 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 (e2d4087e-ce41-4610-8864-bca8bd16fc40): created successfully Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3c8431-a01e-48b0-ba08-0dc050bd9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (90c68af2-6f7f-466d-91bf-8342985c513b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:58 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4b6e2dae-ede6-43a9-9aa1-0ec60e2fe905 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created volume successfully. Feb 27 22:31:58 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-cae91ef6-07eb-45e5-a204-eeacb071e0ac" returned: 0 in 0.502s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-cae91ef6-07eb-45e5-a204-eeacb071e0ac" released by "delete_volume" :: held 1.193s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Created reservations ['d7cb83bf-2056-4268-b5f8-0bfe905b98b0', '3f288b27-df29-461d-a199-9d5d23fbfc2b', '44d96628-1468-475c-865e-7e12a0fac2ad', '9b7cb33e-c53d-4267-b0a5-4b2c64497012'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:31:58 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 1073741824" returned: 0 in 0.600s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:58 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:31:58 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:58 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:58 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 Feb 27 22:31:58 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:59 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.488s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:31:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Deleted volume successfully. Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d33fafb-1146-4d26-a608-88375a07f71b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-cae91ef6-07eb-45e5-a204-eeacb071e0ac-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:31:59 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274" returned: 0 in 0.501s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.921s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669323334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2896651-a3ff-477c-a046-6004cf0e93a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:48Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Creating volume b2896651-a3ff-477c-a046-6004cf0e93a8 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:31:59 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acf5ec3-dc37-4df5-aa23-5a312273823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:59 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 1073741824 Feb 27 22:31:59 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e094f3e8-099f-45db-90f3-d2c9ab128ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:31:59 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 (392cf24e-66e4-4cc6-ae43-b8621fcd7274): created successfully Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e094f3e8-099f-45db-90f3-d2c9ab128ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (298d451b-e63c-46f2-ae68-80731e5a4477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:31:59 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8adb6173-0d9e-4841-bb9e-a4cf82aa85fd tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created volume successfully. Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-ee0df216-9256-4df7-9d59-0a18997ee40a-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-ee0df216-9256-4df7-9d59-0a18997ee40a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-quobyte-ee0df216-9256-4df7-9d59-0a18997ee40a" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-ee0df216-9256-4df7-9d59-0a18997ee40a" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba3839b-76e9-4323-8d07-0c18d7f64f2a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:59 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a Feb 27 22:31:59 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:31:59 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 1073741824" returned: 0 in 0.560s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:31:59 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:31:59 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 Feb 27 22:31:59 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:00 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a" returned: 0 in 0.744s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:00 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a Feb 27 22:32:00 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:00 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8" returned: 0 in 0.596s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.823s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117714003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3ddb3d-76df-46cc-bacf-564560d454f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b2dcb053544c0797f0959943be09ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:31:49Z,use_quota=True,user_id='067b0d72d912483b939b91d7726e2930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Creating volume ff3ddb3d-76df-46cc-bacf-564560d454f9 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:00 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517e0bcd-9c58-442d-bf26-efb381e3efa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2896651-a3ff-477c-a046-6004cf0e93a8', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97df5a1-4b3b-41b4-8ba6-bc112c454961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:00 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 1073741824 Feb 27 22:32:00 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:00 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume volume-b2896651-a3ff-477c-a046-6004cf0e93a8 (b2896651-a3ff-477c-a046-6004cf0e93a8): created successfully Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97df5a1-4b3b-41b4-8ba6-bc112c454961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (21d5351c-1184-4d7f-8436-229117814bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:00 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-62fd0a5e-6d44-439e-a9f4-dab6b4d87517 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created volume successfully. Feb 27 22:32:00 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ee0df216-9256-4df7-9d59-0a18997ee40a" returned: 0 in 0.517s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-ee0df216-9256-4df7-9d59-0a18997ee40a" released by "delete_volume" :: held 1.293s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Flow 'volume_create_manager' (a61db35f-f308-49c7-877b-ec407e5ad295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423cd713-3559-45b5-837d-c6fa60fa3b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423cd713-3559-45b5-837d-c6fa60fa3b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-962991769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58106cef-fe84-4d74-ab7b-1a71ad041214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835e37421cad4a06b9d991339f95bd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:01Z,use_quota=True,user_id='2e0acbd5475a48a58014f5cec012589e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb63dd9f-17b4-40ad-bb22-76194825fb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb63dd9f-17b4-40ad-bb22-76194825fb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71accbf0-f6eb-4804-8472-fa3b7b222f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71accbf0-f6eb-4804-8472-fa3b7b222f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58106cef-fe84-4d74-ab7b-1a71ad041214', 'volume_name': 'volume-58106cef-fe84-4d74-ab7b-1a71ad041214', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:00 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4de2a6d-c5e6-4d48-922c-2fa08b9be6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4de2a6d-c5e6-4d48-922c-2fa08b9be6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e690e3ec-8442-42cf-b720-ec098c2367b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:01 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Volume 58106cef-fe84-4d74-ab7b-1a71ad041214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58106cef-fe84-4d74-ab7b-1a71ad041214', 'volume_size': 1} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Created reservations ['af3b4dbe-a4ef-4cbd-a0ef-4fce2309b421', 'e1ad3e91-0162-479b-93bf-2dc1c6d36d72', '23eddcd4-526d-4c22-8e01-047ba50e12fc', '48e76bde-5dce-40d1-af92-6baea9a38181'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:01 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 1073741824" returned: 0 in 0.572s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:01 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:01 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:01 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 Feb 27 22:32:01 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:01 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.422s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:01 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Deleted volume successfully. Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9f18a61f-a98a-4544-a13f-d40217ea8a0b tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-ee0df216-9256-4df7-9d59-0a18997ee40a-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:01 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9" returned: 0 in 0.457s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.407s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-0bcdd2de-381a-4dab-893f-5bd62c9c08f5-c5f5abed-4708-4087-be38-961beea9f1f9" by "_create_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04318129-33d7-49b1-9226-5285f0e2444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3ddb3d-76df-46cc-bacf-564560d454f9', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a4be89-55c9-472f-a084-cca74dd33bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-0bcdd2de-381a-4dab-893f-5bd62c9c08f5-c5f5abed-4708-4087-be38-961beea9f1f9" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Creating volume c5f5abed-4708-4087-be38-961beea9f1f9 from snapshot 0bcdd2de-381a-4dab-893f-5bd62c9c08f5 {{(pid=83540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-c5f5abed-4708-4087-be38-961beea9f1f9" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:01 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Volume volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 (ff3ddb3d-76df-46cc-bacf-564560d454f9): created successfully Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a4be89-55c9-472f-a084-cca74dd33bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Flow 'volume_create_manager' (ba7aae36-6466-4f29-ac96-fdf8f3ec7d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-c5f5abed-4708-4087-be38-961beea9f1f9" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] snapshot: 0bcdd2de-381a-4dab-893f-5bd62c9c08f5, volume: c5f5abed-4708-4087-be38-961beea9f1f9, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:32:01 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0522bf0e-baa2-4d80-9d14-1357c7788e01 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created volume successfully. Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ae0428-89e0-411f-8981-6b29f03b1736]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:01 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 Feb 27 22:32:01 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-819b734f-98ac-4a3d-8b91-222a94757c80-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-819b734f-98ac-4a3d-8b91-222a94757c80-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "cinder-quobyte-819b734f-98ac-4a3d-8b91-222a94757c80" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-819b734f-98ac-4a3d-8b91-222a94757c80" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6286686-a7b6-4123-b2aa-35cf2de3e74a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:01 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:01 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 Feb 27 22:32:01 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:02 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34efaa7-5990-4f09-99ff-71067cad40c4]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:02 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 Feb 27 22:32:02 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:02 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80" returned: 0 in 0.545s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:02 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80 Feb 27 22:32:02 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-ff3ddb3d-76df-46cc-bacf-564560d454f9-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-ff3ddb3d-76df-46cc-bacf-564560d454f9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-quobyte-ff3ddb3d-76df-46cc-bacf-564560d454f9" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-ff3ddb3d-76df-46cc-bacf-564560d454f9" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ca81c8-4b64-46ce-86b5-e8cb29d290b6]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:02 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 Feb 27 22:32:02 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:02 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321" returned: 0 in 0.581s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:02 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 Feb 27 22:32:02 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:02 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-819b734f-98ac-4a3d-8b91-222a94757c80" returned: 0 in 0.437s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-quobyte-819b734f-98ac-4a3d-8b91-222a94757c80" released by "delete_volume" :: held 1.019s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Created reservations ['e8aff6a0-77d1-444a-ba67-5910a3230fb6', '70302eb4-117b-4fd8-a37a-3869a9a433a6', '1ca57fd9-3dcf-42e7-a33e-5fb6c25f68f2', 'f660e934-6f91-4f57-a5c4-6b4412e2bc34'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:02 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:02 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:02 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:03 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9" returned: 0 in 0.536s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:03 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9 Feb 27 22:32:03 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:03 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:03 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.810s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:03 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:03 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Deleted volume successfully. Feb 27 22:32:03 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-334c7793-c450-42d3-94a0-2e1d88d83c88 tempest-CreateVolumesFromImageTest-1951364129 None] Lock "cinder-819b734f-98ac-4a3d-8b91-222a94757c80-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:04 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-ff3ddb3d-76df-46cc-bacf-564560d454f9" returned: 0 in 1.367s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-ff3ddb3d-76df-46cc-bacf-564560d454f9" released by "delete_volume" :: held 1.931s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created reservations ['32d4e2b7-a7a3-4bc1-aca8-bee12a935171', 'd8ce893b-f1b9-4fb8-b60d-5c7e8ec31fb4', '9d5e3046-5234-4c6d-ae54-357cd4d352ff', '819ac517-5c4d-48f7-9962-77e80c1b9afe'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:04 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:04 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:04 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-b2896651-a3ff-477c-a046-6004cf0e93a8-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-b2896651-a3ff-477c-a046-6004cf0e93a8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-quobyte-b2896651-a3ff-477c-a046-6004cf0e93a8" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-b2896651-a3ff-477c-a046-6004cf0e93a8" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df2ee1-8870-48e1-94d8-3c9daeafcb6f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:05 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9" returned: 0 in 2.440s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e129d8df-ebc0-4024-a663-7b94a833cab5]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:05 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 Feb 27 22:32:05 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:05 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 Feb 27 22:32:05 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:05 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.611s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:05 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Deleted volume successfully. Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a2f6c28c-913a-4b3e-aab4-0888722e4512 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-ff3ddb3d-76df-46cc-bacf-564560d454f9-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:05 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8" returned: 0 in 0.632s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:05 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:05 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8 Feb 27 22:32:05 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:06 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321" returned: 0 in 0.848s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:32:06 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Converted 1024.00 MB image at 419.17 MB/s Feb 27 22:32:06 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 is being set with open permissions: ugo+rw Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:06 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 Feb 27 22:32:06 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:06 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-b2896651-a3ff-477c-a046-6004cf0e93a8" returned: 0 in 0.448s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-b2896651-a3ff-477c-a046-6004cf0e93a8" released by "delete_volume" :: held 1.124s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created reservations ['b1966637-0dc5-4dfa-8009-329c3415125d', '8543a175-56ca-4061-ac39-2339b8fd8bbf', '05c28da5-0700-4745-b4ac-be8b08d6acd0', 'f897d123-fad4-4e16-bced-ae05ad881171'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:06 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:06 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:06 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9" returned: 0 in 0.528s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-c5f5abed-4708-4087-be38-961beea9f1f9" released by "_copy_volume_from_snapshot" :: held 4.991s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-0bcdd2de-381a-4dab-893f-5bd62c9c08f5-c5f5abed-4708-4087-be38-961beea9f1f9" released by "_create_volume_from_snapshot" :: held 5.028s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.052s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.615s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-962991769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58106cef-fe84-4d74-ab7b-1a71ad041214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835e37421cad4a06b9d991339f95bd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:01Z,use_quota=True,user_id='2e0acbd5475a48a58014f5cec012589e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Creating volume 58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:06 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:06 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 1073741824 Feb 27 22:32:06 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b92472-5502-4246-b957-c56fb54a242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f5abed-4708-4087-be38-961beea9f1f9', 'volume_size': 1, 'snapshot_id': '0bcdd2de-381a-4dab-893f-5bd62c9c08f5'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be549e0-3f81-4416-844e-cee733899b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:06 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Volume volume-c5f5abed-4708-4087-be38-961beea9f1f9 (c5f5abed-4708-4087-be38-961beea9f1f9): created successfully Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be549e0-3f81-4416-844e-cee733899b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Flow 'volume_create_manager' (f7ed7940-4878-4c12-99d2-646d77570209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:06 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-c4217bde-3a8f-4dd9-ad48-0ee892126aaa tempest-VolumeDependencyTests-522888339 None] Created volume successfully. Feb 27 22:32:06 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-0bcdd2de-381a-4dab-893f-5bd62c9c08f5-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.523s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:06 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Deleted volume successfully. Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Lock "cinder-0bcdd2de-381a-4dab-893f-5bd62c9c08f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-38070ced-f6e0-46a8-a83b-8be0c3f0a321" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-2a314ee6-cd89-44fa-a473-8439163c89b4 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-b2896651-a3ff-477c-a046-6004cf0e93a8-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-38070ced-f6e0-46a8-a83b-8be0c3f0a321" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-0bcdd2de-381a-4dab-893f-5bd62c9c08f5" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-0bcdd2de-381a-4dab-893f-5bd62c9c08f5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Deleting offline snapshot 0bcdd2de-381a-4dab-893f-5bd62c9c08f5 of volume 38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] snapshot_file for this snap is: volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c6448f-e9ad-4493-bf89-26f6a60154e6]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:06 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:07 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 Feb 27 22:32:07 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (0d2e8c01-58fb-4b4d-b41b-7a1cbeb0ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f816493-7ce5-4774-88a7-9b3bf44fbeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f816493-7ce5-4774-88a7-9b3bf44fbeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-850157702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de896f3d-9c89-46a1-a7f8-f93d658cde4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:07Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e20d30b-cd8f-4c4f-a982-3ee562870980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e20d30b-cd8f-4c4f-a982-3ee562870980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e1e993-c1ef-429c-811b-bd60e270dcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e1e993-c1ef-429c-811b-bd60e270dcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de896f3d-9c89-46a1-a7f8-f93d658cde4b', 'volume_name': 'volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37379580-994d-4510-8346-92cf80b85387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37379580-994d-4510-8346-92cf80b85387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d1a266-1824-40b0-b234-d128f34cf1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:07 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume de896f3d-9c89-46a1-a7f8-f93d658cde4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b', 'volume_size': 1} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:07 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 1073741824" returned: 0 in 0.664s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:07 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 Feb 27 22:32:07 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-392cf24e-66e4-4cc6-ae43-b8621fcd7274-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-392cf24e-66e4-4cc6-ae43-b8621fcd7274-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-quobyte-392cf24e-66e4-4cc6-ae43-b8621fcd7274" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-392cf24e-66e4-4cc6-ae43-b8621fcd7274" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d50f20-5014-4b25-b9ae-ae68381f71aa]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:07 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 Feb 27 22:32:07 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:07 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5" returned: 0 in 0.593s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5310a-5001-498e-a6ca-a259cd3098dd]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:07 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 Feb 27 22:32:07 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:07 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214" returned: 0 in 0.458s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-850157702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de896f3d-9c89-46a1-a7f8-f93d658cde4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:07Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Creating volume de896f3d-9c89-46a1-a7f8-f93d658cde4b {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:07 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e690e3ec-8442-42cf-b720-ec098c2367b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58106cef-fe84-4d74-ab7b-1a71ad041214', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:07 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b 1073741824 Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17157719-8324-4e46-852e-6dfe28848f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:07 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:07 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Volume volume-58106cef-fe84-4d74-ab7b-1a71ad041214 (58106cef-fe84-4d74-ab7b-1a71ad041214): created successfully Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17157719-8324-4e46-852e-6dfe28848f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Flow 'volume_create_manager' (a61db35f-f308-49c7-877b-ec407e5ad295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:07 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f1fdaa83-6ab6-4875-96f9-a74f33226b6a tempest-SnapshotDependencyTests-1725798886 None] Created volume successfully. Feb 27 22:32:07 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:07 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:07 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274 Feb 27 22:32:07 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:08 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321" returned: 0 in 0.527s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:08 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 Feb 27 22:32:08 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:08 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b 1073741824" returned: 0 in 0.561s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:08 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b Feb 27 22:32:08 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:08 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-392cf24e-66e4-4cc6-ae43-b8621fcd7274" returned: 0 in 0.485s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-392cf24e-66e4-4cc6-ae43-b8621fcd7274" released by "delete_volume" :: held 1.036s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created reservations ['f10dbcac-e899-4f0b-b128-91d8cb3bc5bd', '5f4522c8-80be-4a62-adb1-c04d6216ead0', 'bb24a408-378a-477c-aa9f-d1432af77bb1', '78a4c383-695a-4988-9cc8-5ab72ceba492'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:08 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:08 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:08 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5" returned: 0 in 0.573s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:08 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5 Feb 27 22:32:08 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:08 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b" returned: 0 in 0.477s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.277s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Creating offline snapshot cebaa4f3-629b-4cb4-a173-0d4655511b2c of volume 58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d1a266-1824-40b0-b234-d128f34cf1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7436fbd9-1227-40ae-a934-c8b8e74e9066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ee460-a101-47e3-9c06-1f420c62dfd9]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:08 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b (de896f3d-9c89-46a1-a7f8-f93d658cde4b): created successfully Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7436fbd9-1227-40ae-a934-c8b8e74e9066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:08 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (0d2e8c01-58fb-4b4d-b41b-7a1cbeb0ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:08 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b0ae6ba4-572a-4180-b452-b5dc28965129 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created volume successfully. Feb 27 22:32:08 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 Feb 27 22:32:08 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:09 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.461s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:09 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Deleted volume successfully. Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-9dfa38f8-218e-4759-9a2c-87dcbabca70a tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-392cf24e-66e4-4cc6-ae43-b8621fcd7274-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:09 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321.0bcdd2de-381a-4dab-893f-5bd62c9c08f5" returned: 0 in 0.431s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-0bcdd2de-381a-4dab-893f-5bd62c9c08f5" released by "_delete_snapshot" :: held 2.175s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-38070ced-f6e0-46a8-a83b-8be0c3f0a321" released by "delete_snapshot" :: held 2.188s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Created reservations ['845b3430-95f3-47df-9f03-728375eaa356', 'c3595ce1-dd8c-45ff-8785-255a90c281d7', 'ddaa1a5e-9199-43dd-88e8-6665d28f025d', '0f7350f9-eb49-4d80-a604-3e6c1ae9d2ff'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:09 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Delete snapshot completed successfully. Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0332687e-5b1b-4c05-b71b-2a736831efda tempest-VolumeDependencyTests-522888339 None] Lock "cinder-0bcdd2de-381a-4dab-893f-5bd62c9c08f5-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:09 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214" returned: 0 in 0.565s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:09 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c 1G Feb 27 22:32:09 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-e2d4087e-ce41-4610-8864-bca8bd16fc40-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-e2d4087e-ce41-4610-8864-bca8bd16fc40-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-quobyte-e2d4087e-ce41-4610-8864-bca8bd16fc40" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-e2d4087e-ce41-4610-8864-bca8bd16fc40" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d247725b-8308-495a-ac32-bdd829560428]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:09 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 Feb 27 22:32:09 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:09 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c 1G" returned: 0 in 0.489s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:09 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58106cef-fe84-4d74-ab7b-1a71ad041214 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:09 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58106cef-fe84-4d74-ab7b-1a71ad041214 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c Feb 27 22:32:09 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-38070ced-f6e0-46a8-a83b-8be0c3f0a321-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Lock "cinder-38070ced-f6e0-46a8-a83b-8be0c3f0a321-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-38070ced-f6e0-46a8-a83b-8be0c3f0a321" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-38070ced-f6e0-46a8-a83b-8be0c3f0a321" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cfd229-96c6-4a79-b352-4eff0260f5fc]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:10 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40" returned: 0 in 0.567s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:10 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 Feb 27 22:32:10 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:10 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40 Feb 27 22:32:10 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:10 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58106cef-fe84-4d74-ab7b-1a71ad041214 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c" returned: 0 in 0.483s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:10 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c is being set with open permissions: ugo+rw Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:10 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c Feb 27 22:32:10 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:10 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e2d4087e-ce41-4610-8864-bca8bd16fc40" returned: 0 in 0.437s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-e2d4087e-ce41-4610-8864-bca8bd16fc40" released by "delete_volume" :: held 1.035s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:10 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321" returned: 0 in 0.536s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created reservations ['eb4b04e1-3ed7-4a84-89a0-cf4c028c8e11', 'd94cb53e-c8dc-49ec-85a0-ded1b006e543', '2fdb5a80-27ba-4646-8ba9-ee6b44e57372', '131ff9fb-3ec8-4b04-a4c9-410232c93c45'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:10 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321 Feb 27 22:32:10 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:10 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:10 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:10 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c" returned: 0 in 0.458s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:10 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:10 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.info Feb 27 22:32:10 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:11 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-38070ced-f6e0-46a8-a83b-8be0c3f0a321" returned: 0 in 0.409s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-38070ced-f6e0-46a8-a83b-8be0c3f0a321" released by "delete_volume" :: held 0.977s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Created reservations ['dcd089d8-4f9c-45c3-a4f6-a25d1cb2b7c0', 'db57b0a5-220b-4d89-988a-f5eb38c697b1', '587706c8-c015-4dba-8fef-29348d6af201', 'b497e008-a25b-42c1-b525-d858b3104440'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:11 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:11 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:11 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.450s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Deleted volume successfully. Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-fd19ae61-d954-44c7-9161-79c049956429 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-e2d4087e-ce41-4610-8864-bca8bd16fc40-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:11 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.info" returned: 0 in 0.458s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:11 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.info is being set with open permissions: ugo+rw Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:11 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.info Feb 27 22:32:11 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:11 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.440s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Deleted volume successfully. Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-eb0fea77-15fc-4f03-9f84-a9d105eb812a tempest-VolumeDependencyTests-522888339 None] Lock "cinder-38070ced-f6e0-46a8-a83b-8be0c3f0a321-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-a949da8d-0288-472a-a65d-ef2736da449e-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-a949da8d-0288-472a-a65d-ef2736da449e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-quobyte-a949da8d-0288-472a-a65d-ef2736da449e" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-a949da8d-0288-472a-a65d-ef2736da449e" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d30720-b56e-41cc-acc5-5ac1fb320d0b]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:11 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.info" returned: 0 in 0.459s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.987s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.480s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:11 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e Feb 27 22:32:11 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Creating offline snapshot 9eb42b9b-1d04-4a02-8ec6-7de598cd1003 of volume de896f3d-9c89-46a1-a7f8-f93d658cde4b {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:32:11 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-b93be3b9-4155-4364-8896-1caf646e2cf1 tempest-SnapshotDependencyTests-1725798886 None] Create snapshot completed successfully Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96367d7-431b-4013-b290-4eca8bee4d53]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:11 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:11 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b Feb 27 22:32:11 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:12 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e" returned: 0 in 0.518s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:12 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e Feb 27 22:32:12 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:12 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b" returned: 0 in 0.511s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:12 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 1G Feb 27 22:32:12 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Flow 'volume_create_manager' (a0a69397-557b-48d2-8538-2d6b4fbd9b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8e735e-a947-4c77-be5d-26d9acfeff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8e735e-a947-4c77-be5d-26d9acfeff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1024524278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdddd79-1f4a-40df-a68f-2dbbfd945a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1b1ab7a359436a93f6f4ff7c8a1b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:12Z,use_quota=True,user_id='9094a6113b6a404682259bc03877761d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98ae5b7-8463-4219-b229-47528beb4d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98ae5b7-8463-4219-b229-47528beb4d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e81e33-b692-43c3-91a3-b52cce55ae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e81e33-b692-43c3-91a3-b52cce55ae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcdddd79-1f4a-40df-a68f-2dbbfd945a80', 'volume_name': 'volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcd154e-2316-4d91-8931-27bc32ac7685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcd154e-2316-4d91-8931-27bc32ac7685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c77183-1ef8-4277-8b0a-c197e660e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:12 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Volume dcdddd79-1f4a-40df-a68f-2dbbfd945a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80', 'volume_size': 1} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:12 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a949da8d-0288-472a-a65d-ef2736da449e" returned: 0 in 0.502s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-a949da8d-0288-472a-a65d-ef2736da449e" released by "delete_volume" :: held 1.057s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created reservations ['f5c71b61-920a-43d0-9491-6f514f5d0269', 'f86d9e0a-380e-4bf2-a5cb-84b4efc6d584', '34328ba5-b8c2-4f94-887b-4ebde25659ae', '79586d00-24bb-4f68-954d-6ce87985e9c8'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:12 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:12 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:12 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 1G" returned: 0 in 0.560s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:12 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:12 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 Feb 27 22:32:12 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Flow 'volume_create_manager' (49acd858-9d44-4553-ba0b-818381862070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841e4bd6-cd85-493a-9f09-d532534c049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841e4bd6-cd85-493a-9f09-d532534c049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5456462-4059-40b2-88ee-3f513f7df085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835e37421cad4a06b9d991339f95bd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cebaa4f3-629b-4cb4-a173-0d4655511b2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:13Z,use_quota=True,user_id='2e0acbd5475a48a58014f5cec012589e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c69c925-3589-416f-9713-6ca8f163ad3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c69c925-3589-416f-9713-6ca8f163ad3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7a9325-35db-429b-a004-302edd992a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7a9325-35db-429b-a004-302edd992a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5456462-4059-40b2-88ee-3f513f7df085', 'volume_name': 'volume-a5456462-4059-40b2-88ee-3f513f7df085', 'volume_size': 1, 'snapshot_id': 'cebaa4f3-629b-4cb4-a173-0d4655511b2c'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4c6a6d-ad7f-4324-8a8c-f9e9843ea2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4c6a6d-ad7f-4324-8a8c-f9e9843ea2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a6f159-521b-410a-a92b-0b54365407c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:13 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Volume a5456462-4059-40b2-88ee-3f513f7df085: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5456462-4059-40b2-88ee-3f513f7df085', 'volume_size': 1, 'snapshot_id': 'cebaa4f3-629b-4cb4-a173-0d4655511b2c'} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:13 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.416s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:13 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Deleted volume successfully. Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8ac8ce78-3284-4073-8f32-1a4c6501eef8 tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-a949da8d-0288-472a-a65d-ef2736da449e-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:13 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003" returned: 0 in 0.472s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:13 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 is being set with open permissions: ugo+rw Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:13 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 Feb 27 22:32:13 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:13 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003" returned: 0 in 0.432s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:13 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.info Feb 27 22:32:13 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-a4884fa8-e782-4452-932d-3982956c6ae7-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-a4884fa8-e782-4452-932d-3982956c6ae7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "cinder-quobyte-a4884fa8-e782-4452-932d-3982956c6ae7" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-a4884fa8-e782-4452-932d-3982956c6ae7" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8b0285-aa92-4d2f-8777-1e21d65a4ec6]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:13 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:14 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 Feb 27 22:32:14 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:14 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.info" returned: 0 in 0.432s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:14 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.info is being set with open permissions: ugo+rw Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:14 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.info Feb 27 22:32:14 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:14 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7" returned: 0 in 0.506s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:14 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7 Feb 27 22:32:14 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:14 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.info" returned: 0 in 0.431s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.912s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.228s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1024524278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdddd79-1f4a-40df-a68f-2dbbfd945a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1b1ab7a359436a93f6f4ff7c8a1b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:12Z,use_quota=True,user_id='9094a6113b6a404682259bc03877761d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Creating volume dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:14 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:14 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 1073741824 Feb 27 22:32:14 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:14 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-593b429c-0c3f-4fc2-b9bc-e987211fe67a tempest-CreateVolumesFromSnapshotTest-1673649529 None] Create snapshot completed successfully Feb 27 22:32:14 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a4884fa8-e782-4452-932d-3982956c6ae7" returned: 0 in 0.452s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-quobyte-a4884fa8-e782-4452-932d-3982956c6ae7" released by "delete_volume" :: held 0.984s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:14 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Created reservations ['03b3eca6-d8fa-48ef-ac87-9e5ac398e018', '9e1e422d-3d6b-4f3d-b76c-78d043ad01e1', '2f76aaed-769f-4c10-80b3-d990b452341a', '731d9cee-43cf-4671-aa3b-b0de7aeef69a'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:15 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:15 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:15 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 1073741824" returned: 0 in 0.556s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:15 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 Feb 27 22:32:15 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:15 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.462s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:15 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Deleted volume successfully. Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-979fdbf7-dcc8-451d-8d56-589c408d843f tempest-CreateVolumesFromSourceVolumeTest-1853925392 None] Lock "cinder-a4884fa8-e782-4452-932d-3982956c6ae7-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:15 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" returned: 0 in 0.424s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.473s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-quobyte-cebaa4f3-629b-4cb4-a173-0d4655511b2c-a5456462-4059-40b2-88ee-3f513f7df085" by "_create_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c77183-1ef8-4277-8b0a-c197e660e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661f8bfc-b992-4fad-85fa-564f9f74475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-cebaa4f3-629b-4cb4-a173-0d4655511b2c-a5456462-4059-40b2-88ee-3f513f7df085" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Creating volume a5456462-4059-40b2-88ee-3f513f7df085 from snapshot cebaa4f3-629b-4cb4-a173-0d4655511b2c {{(pid=83540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-quobyte-a5456462-4059-40b2-88ee-3f513f7df085" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:15 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Volume volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 (dcdddd79-1f4a-40df-a68f-2dbbfd945a80): created successfully Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661f8bfc-b992-4fad-85fa-564f9f74475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Flow 'volume_create_manager' (a0a69397-557b-48d2-8538-2d6b4fbd9b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:15 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-aacb029a-7413-4ffc-bf59-42982cc21eed tempest-VolumeDependencyTests-522888339 None] Created volume successfully. Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-a5456462-4059-40b2-88ee-3f513f7df085" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] snapshot: cebaa4f3-629b-4cb4-a173-0d4655511b2c, volume: a5456462-4059-40b2-88ee-3f513f7df085, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (10b47209-94b7-4710-8480-1cf8f7679436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77de3cc-462c-400d-8b14-dbaccda254fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[789ffb0c-5657-463c-9e88-e3b364e2dd1c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:15 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77de3cc-462c-400d-8b14-dbaccda254fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948074857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9c9146-efd2-4f6f-b0eb-51b1eddf8180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:16Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05444461-7c70-4e22-8911-7f566a7f4bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05444461-7c70-4e22-8911-7f566a7f4bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c100b635-6bbd-4808-9ae0-9c6e550b87a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c100b635-6bbd-4808-9ae0-9c6e550b87a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9c9146-efd2-4f6f-b0eb-51b1eddf8180', 'volume_name': 'volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2f3214-68ae-4a27-91c8-d08251057674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2f3214-68ae-4a27-91c8-d08251057674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41da363d-9a31-41c9-8037-e56e06c375da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume af9c9146-efd2-4f6f-b0eb-51b1eddf8180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180', 'volume_size': 1} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:16 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c Feb 27 22:32:16 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (f971d2a1-9f16-480d-8fdc-48042b9604be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff6222f-6cf6-4c8d-9850-8a73b9a0e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff6222f-6cf6-4c8d-9850-8a73b9a0e114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434761699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3223fcc4-ba3f-4f67-b7b7-08709e2cdef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:16Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9637523d-777f-487f-a0ad-976010b8fe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9637523d-777f-487f-a0ad-976010b8fe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0913fd71-e235-4e0b-a2a4-c72bc44e45ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0913fd71-e235-4e0b-a2a4-c72bc44e45ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3223fcc4-ba3f-4f67-b7b7-08709e2cdef5', 'volume_name': 'volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a51f6b-8dac-4ac8-a36c-537bc5013fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a51f6b-8dac-4ac8-a36c-537bc5013fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad10847-3ab3-4c19-b6c2-b45437901968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume 3223fcc4-ba3f-4f67-b7b7-08709e2cdef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5', 'volume_size': 1} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (082dc86b-2db9-49cc-8564-9e90a6e20290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95900256-2702-47e2-b907-43a663faf190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95900256-2702-47e2-b907-43a663faf190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1671217190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46426363-4883-42b5-a4fe-d04758f257a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:16Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed90184c-a190-4497-b8c5-5fb3b7f790cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed90184c-a190-4497-b8c5-5fb3b7f790cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a9a2f-2433-4d21-841a-6d7371bb15c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a9a2f-2433-4d21-841a-6d7371bb15c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46426363-4883-42b5-a4fe-d04758f257a6', 'volume_name': 'volume-46426363-4883-42b5-a4fe-d04758f257a6', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c81f721-d264-44ad-b5d7-da45873957f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c81f721-d264-44ad-b5d7-da45873957f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bc35c6-8adc-4874-bb8b-53b44918e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume 46426363-4883-42b5-a4fe-d04758f257a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46426363-4883-42b5-a4fe-d04758f257a6', 'volume_size': 1} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (8b869f66-511b-46a5-ae4c-a7a4fc0981af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9858386-0899-4add-a59e-91a59e78193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9858386-0899-4add-a59e-91a59e78193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686705237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a781d2-aa5e-4d0d-be92-a1ccf273482d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:16Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567b1d09-c4a0-48f1-b8cc-f1a88783b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567b1d09-c4a0-48f1-b8cc-f1a88783b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfca37cb-1518-40ad-9c6d-4341c4c236aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfca37cb-1518-40ad-9c6d-4341c4c236aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a781d2-aa5e-4d0d-be92-a1ccf273482d', 'volume_name': 'volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf5579c-5a2a-4366-89d0-ffc8aa2aedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf5579c-5a2a-4366-89d0-ffc8aa2aedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53276d01-c12f-4197-bd96-b60c518d5b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume e9a781d2-aa5e-4d0d-be92-a1ccf273482d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d', 'volume_size': 1} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:16 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c" returned: 0 in 0.719s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58106cef-fe84-4d74-ab7b-1a71ad041214(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb7cdf0-d951-43bf-ad17-ff2a38dad007]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (8ae00929-7673-4ed9-a738-82aeadf5bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cad509a-751f-4a6f-a670-398d5ca44673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cad509a-751f-4a6f-a670-398d5ca44673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-311756414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c8cdbc-66ec-499d-9018-44c1471f0f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:17Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 Feb 27 22:32:16 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e7cff2-ef91-4a9c-9fc2-00e32e76f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e7cff2-ef91-4a9c-9fc2-00e32e76f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003b4173-e1df-4a79-97ed-86d237868163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003b4173-e1df-4a79-97ed-86d237868163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c8cdbc-66ec-499d-9018-44c1471f0f1e', 'volume_name': 'volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c507db-77fd-44f9-9493-2920a15c2f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c507db-77fd-44f9-9493-2920a15c2f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f47ec8b-8dc8-432a-ab7f-92f1c7836af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:16 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume 06c8cdbc-66ec-499d-9018-44c1471f0f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e', 'volume_size': 1} Feb 27 22:32:16 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Flow 'volume_create_manager' (e3cdabc0-50d6-47bc-992a-8ac2eeacb11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3120547d-dd50-45b8-8984-6d165668977e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3120547d-dd50-45b8-8984-6d165668977e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-330828394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b5140d-8b14-4f49-8f11-a3d66e9504f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1b1ab7a359436a93f6f4ff7c8a1b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dcdddd79-1f4a-40df-a68f-2dbbfd945a80,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:17Z,use_quota=True,user_id='9094a6113b6a404682259bc03877761d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86061bb6-103a-4f51-8867-6e33f54307c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86061bb6-103a-4f51-8867-6e33f54307c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ec0558-8207-49a0-8c56-3c4bf1cd604c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ec0558-8207-49a0-8c56-3c4bf1cd604c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '90b5140d-8b14-4f49-8f11-a3d66e9504f4', 'volume_name': 'volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4', 'volume_size': 1, 'source_volid': 'dcdddd79-1f4a-40df-a68f-2dbbfd945a80', 'source_volstatus': 'available'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e144e78d-1868-4783-aec2-919fa1be393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e144e78d-1868-4783-aec2-919fa1be393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e09c75-b227-4c05-b44e-a58f0d47ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:17 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Volume 90b5140d-8b14-4f49-8f11-a3d66e9504f4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4', 'volume_size': 1, 'source_volid': 'dcdddd79-1f4a-40df-a68f-2dbbfd945a80', 'source_volstatus': 'available'} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:17 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214" returned: 0 in 0.609s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:32:17 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:17 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 Feb 27 22:32:17 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Flow 'volume_create_manager' (f059442a-908c-46a6-9f44-c7c4ddab9542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a0102a-c575-48ea-b6be-4f3e0f82a384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a0102a-c575-48ea-b6be-4f3e0f82a384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefa2b5d-0b85-4303-823a-9f59850f8914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495204ad23a84862b8c81727ffdb5e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:18Z,use_quota=True,user_id='34fd851666c7432882149da1bf63444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26959d3b-e111-4381-a022-ffdc7b58c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26959d3b-e111-4381-a022-ffdc7b58c408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1736d57a-b432-47f8-bd6f-46bc599f0293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1736d57a-b432-47f8-bd6f-46bc599f0293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eefa2b5d-0b85-4303-823a-9f59850f8914', 'volume_name': 'volume-eefa2b5d-0b85-4303-823a-9f59850f8914', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e46b14-dd49-4aa8-bce4-6e81401edd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e46b14-dd49-4aa8-bce4-6e81401edd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40fa58e-d437-4992-b4f8-2e086801b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:18 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Volume eefa2b5d-0b85-4303-823a-9f59850f8914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eefa2b5d-0b85-4303-823a-9f59850f8914', 'volume_size': 1} Feb 27 22:32:18 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:19 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085" returned: 0 in 2.415s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:19 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[044f0b0e-8be4-4703-947d-a2b9c6f9d1fb]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:19 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:19 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 Feb 27 22:32:19 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:20 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214" returned: 0 in 0.624s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:32:20 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Converted 1024.00 MB image at 423.67 MB/s Feb 27 22:32:20 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 is being set with open permissions: ugo+rw Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:20 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 Feb 27 22:32:20 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:20 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085" returned: 0 in 0.415s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-a5456462-4059-40b2-88ee-3f513f7df085" released by "_copy_volume_from_snapshot" :: held 4.891s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-cebaa4f3-629b-4cb4-a173-0d4655511b2c-a5456462-4059-40b2-88ee-3f513f7df085" released by "_create_volume_from_snapshot" :: held 4.951s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.012s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.763s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948074857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9c9146-efd2-4f6f-b0eb-51b1eddf8180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:16Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Creating volume af9c9146-efd2-4f6f-b0eb-51b1eddf8180 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:20 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:20 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 1073741824 Feb 27 22:32:20 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a6f159-521b-410a-a92b-0b54365407c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5456462-4059-40b2-88ee-3f513f7df085', 'volume_size': 1, 'snapshot_id': 'cebaa4f3-629b-4cb4-a173-0d4655511b2c'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054e825a-2f86-400e-ada8-dd1aa6014bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:20 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Volume volume-a5456462-4059-40b2-88ee-3f513f7df085 (a5456462-4059-40b2-88ee-3f513f7df085): created successfully Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054e825a-2f86-400e-ada8-dd1aa6014bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:20 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Flow 'volume_create_manager' (49acd858-9d44-4553-ba0b-818381862070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:20 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-727b2dd6-f194-4481-9e76-c08a834b8809 tempest-SnapshotDependencyTests-1725798886 None] Created volume successfully. Feb 27 22:32:21 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 1073741824" returned: 0 in 0.469s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:21 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 Feb 27 22:32:21 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-cebaa4f3-629b-4cb4-a173-0d4655511b2c-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-cebaa4f3-629b-4cb4-a173-0d4655511b2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-quobyte-58106cef-fe84-4d74-ab7b-1a71ad041214" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-58106cef-fe84-4d74-ab7b-1a71ad041214" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-quobyte-cebaa4f3-629b-4cb4-a173-0d4655511b2c" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-cebaa4f3-629b-4cb4-a173-0d4655511b2c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Deleting offline snapshot cebaa4f3-629b-4cb4-a173-0d4655511b2c of volume 58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] snapshot_file for this snap is: volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[79598b2b-93c2-4b56-b395-eba648b35bb3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:21 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180" returned: 0 in 0.429s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.569s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434761699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3223fcc4-ba3f-4f67-b7b7-08709e2cdef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:16Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Creating volume 3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:21 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41da363d-9a31-41c9-8037-e56e06c375da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f95d4d-629f-41ec-a459-35089f4ba18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:21 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 1073741824 Feb 27 22:32:21 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:21 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c Feb 27 22:32:21 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 (af9c9146-efd2-4f6f-b0eb-51b1eddf8180): created successfully Feb 27 22:32:21 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f95d4d-629f-41ec-a459-35089f4ba18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:21 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (10b47209-94b7-4710-8480-1cf8f7679436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:21 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-bc8a8b9d-2b66-4e32-88d9-16aadf95c5d4 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created volume successfully. Feb 27 22:32:22 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c" returned: 0 in 0.519s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58106cef-fe84-4d74-ab7b-1a71ad041214(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffb509e-caaa-4073-88cc-df2e25efe4e8]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:22 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 1073741824" returned: 0 in 0.491s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:22 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 Feb 27 22:32:22 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:22 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 Feb 27 22:32:22 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:22 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5" returned: 0 in 0.425s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.326s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1671217190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46426363-4883-42b5-a4fe-d04758f257a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:16Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Creating volume 46426363-4883-42b5-a4fe-d04758f257a6 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:22 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:22 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214" returned: 0 in 0.498s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:22 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 1073741824 Feb 27 22:32:22 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad10847-3ab3-4c19-b6c2-b45437901968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69980fd8-3835-4d24-b6b8-61cfae376737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:22 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c Feb 27 22:32:22 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:22 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 (3223fcc4-ba3f-4f67-b7b7-08709e2cdef5): created successfully Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69980fd8-3835-4d24-b6b8-61cfae376737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:22 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (f971d2a1-9f16-480d-8fdc-48042b9604be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:22 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-25994092-410b-44ca-88f7-cb0b0ec15d22 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created volume successfully. Feb 27 22:32:23 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c" returned: 0 in 0.442s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:23 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c Feb 27 22:32:23 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:23 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 1073741824" returned: 0 in 0.492s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:23 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 Feb 27 22:32:23 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:23 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214.cebaa4f3-629b-4cb4-a173-0d4655511b2c" returned: 0 in 0.422s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-cebaa4f3-629b-4cb4-a173-0d4655511b2c" released by "_delete_snapshot" :: held 1.948s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-58106cef-fe84-4d74-ab7b-1a71ad041214" released by "delete_snapshot" :: held 1.959s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:23 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6" returned: 0 in 0.421s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.027s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686705237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a781d2-aa5e-4d0d-be92-a1ccf273482d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:16Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Creating volume e9a781d2-aa5e-4d0d-be92-a1ccf273482d {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:23 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bc35c6-8adc-4874-bb8b-53b44918e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46426363-4883-42b5-a4fe-d04758f257a6', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:23 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d 1073741824 Feb 27 22:32:23 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6463d2df-76c6-463b-abef-a48281504618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:23 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume volume-46426363-4883-42b5-a4fe-d04758f257a6 (46426363-4883-42b5-a4fe-d04758f257a6): created successfully Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6463d2df-76c6-463b-abef-a48281504618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (082dc86b-2db9-49cc-8564-9e90a6e20290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:23 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-1f9a01a2-7a29-4351-99de-612031da3655 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created volume successfully. Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Created reservations ['e208d690-4568-4f9b-9a0d-d19f32eb77bb', 'c5c5d993-8be6-4a64-8497-70d0cec5d081', 'b03f46d6-d29b-46c6-95d1-475b54668418', 'cc0ace8a-02dc-4de6-b23c-6f1de84af540'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:23 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Delete snapshot completed successfully. Feb 27 22:32:23 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-569bd224-3a28-4327-b75b-5cfaa984a21f tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-cebaa4f3-629b-4cb4-a173-0d4655511b2c-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:24 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d 1073741824" returned: 0 in 0.475s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:24 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d Feb 27 22:32:24 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:24 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d" returned: 0 in 0.417s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.722s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-311756414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c8cdbc-66ec-499d-9018-44c1471f0f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c20511c82942e9b3abe86ef2a36c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:17Z,use_quota=True,user_id='054c2b248590407197332e8458a5282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Creating volume 06c8cdbc-66ec-499d-9018-44c1471f0f1e {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:24 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53276d01-c12f-4197-bd96-b60c518d5b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:24 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e 1073741824 Feb 27 22:32:24 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3c06c3-450e-44a2-a3d4-b8f4bfac3afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:24 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d (e9a781d2-aa5e-4d0d-be92-a1ccf273482d): created successfully Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3c06c3-450e-44a2-a3d4-b8f4bfac3afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (8b869f66-511b-46a5-ae4c-a7a4fc0981af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:24 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-20b77f1d-4903-4ff9-8da8-249a095541f1 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created volume successfully. Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-58106cef-fe84-4d74-ab7b-1a71ad041214-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-58106cef-fe84-4d74-ab7b-1a71ad041214-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-quobyte-58106cef-fe84-4d74-ab7b-1a71ad041214" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-58106cef-fe84-4d74-ab7b-1a71ad041214" acquired by "delete_volume" :: waited 0.006s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6434106-118e-4296-bab0-75b2710b9f9d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:24 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:24 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 Feb 27 22:32:24 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:25 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e 1073741824" returned: 0 in 0.480s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:25 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e Feb 27 22:32:25 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:25 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214" returned: 0 in 0.527s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:25 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214 Feb 27 22:32:25 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:25 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e" returned: 0 in 0.392s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.267s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:25 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Cloning volume dcdddd79-1f4a-40df-a68f-2dbbfd945a80 to volume 90b5140d-8b14-4f49-8f11-a3d66e9504f4 Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f47ec8b-8dc8-432a-ab7f-92f1c7836af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92475af-1a0d-46c4-99dd-3ec24ca67c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Creating offline snapshot 2577a23d-2dd6-4bae-b5e4-4620fb1de251 of volume dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:32:25 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Volume volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e (06c8cdbc-66ec-499d-9018-44c1471f0f1e): created successfully Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92475af-1a0d-46c4-99dd-3ec24ca67c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Flow 'volume_create_manager' (8ae00929-7673-4ed9-a738-82aeadf5bb58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e560f-a45b-496b-8bc1-61e0f12fe55a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:25 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0ea05529-af7b-40a7-a728-22370b67e195 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created volume successfully. Feb 27 22:32:25 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 Feb 27 22:32:25 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:25 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-58106cef-fe84-4d74-ab7b-1a71ad041214" returned: 0 in 0.413s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-58106cef-fe84-4d74-ab7b-1a71ad041214" released by "delete_volume" :: held 0.972s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Created reservations ['789e3c0f-3598-47b5-8ccc-ffa43799e41d', '6dc3989c-12c0-45a2-b66d-725b851ac08a', '6bdddb18-5b22-4a68-83db-97443f6b567f', '43ce691b-2eb8-474c-b115-c048f8b6bf04'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:25 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:25 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-a5456462-4059-40b2-88ee-3f513f7df085-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:25 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-a5456462-4059-40b2-88ee-3f513f7df085-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "cinder-quobyte-a5456462-4059-40b2-88ee-3f513f7df085" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-a5456462-4059-40b2-88ee-3f513f7df085" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcb20c2-c509-4952-b0c0-a21258ce24b6]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:26 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" returned: 0 in 0.528s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:26 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 Feb 27 22:32:26 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:26 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 1G Feb 27 22:32:26 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:26 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.404s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:26 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Deleted volume successfully. Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-7f2823ce-b01e-49ad-8932-236cf9e79d8e tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-58106cef-fe84-4d74-ab7b-1a71ad041214-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:26 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085" returned: 0 in 0.483s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:26 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085 Feb 27 22:32:26 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-06c8cdbc-66ec-499d-9018-44c1471f0f1e-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-06c8cdbc-66ec-499d-9018-44c1471f0f1e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-quobyte-06c8cdbc-66ec-499d-9018-44c1471f0f1e" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-06c8cdbc-66ec-499d-9018-44c1471f0f1e" acquired by "delete_volume" :: waited 0.019s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efd323-6c11-4cfd-9607-fc3d16e1ae83]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:26 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 1G" returned: 0 in 0.563s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:26 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 Feb 27 22:32:26 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:26 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e Feb 27 22:32:26 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:26 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-a5456462-4059-40b2-88ee-3f513f7df085" returned: 0 in 0.473s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:26 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-quobyte-a5456462-4059-40b2-88ee-3f513f7df085" released by "delete_volume" :: held 0.979s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Created reservations ['f6d47479-df94-4677-9431-cd835be58eec', 'b468e3cb-f7aa-4d87-a9fe-61d4ed370abe', 'e491ef3f-174d-4790-a6e7-bdba5cb19503', 'e1480a7b-896e-49f1-a660-69fcd9cd1815'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:27 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:27 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:27 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251" returned: 0 in 0.472s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:27 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 is being set with open permissions: ugo+rw Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:27 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 Feb 27 22:32:27 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:27 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e" returned: 0 in 0.545s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:27 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e Feb 27 22:32:27 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:27 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.491s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:27 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Deleted volume successfully. Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3a4c18df-303b-4b84-b8a1-1529b363da9e tempest-SnapshotDependencyTests-1725798886 None] Lock "cinder-a5456462-4059-40b2-88ee-3f513f7df085-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:27 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-06c8cdbc-66ec-499d-9018-44c1471f0f1e" returned: 0 in 0.431s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:27 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-06c8cdbc-66ec-499d-9018-44c1471f0f1e" released by "delete_volume" :: held 1.012s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251" returned: 0 in 0.508s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:27 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.info Feb 27 22:32:27 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created reservations ['d80d3237-fb08-48d3-80d4-f9fa816f3712', 'c1538e77-11b2-4ce2-bb67-eab118667e62', '25ad353e-eaff-4538-9fed-8dacafcb67b9', 'b78ecb64-0e55-4bec-9e7d-49ba3e791a03'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:27 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:27 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:27 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:28 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.info" returned: 0 in 0.432s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:28 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.info is being set with open permissions: ugo+rw Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:28 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.info Feb 27 22:32:28 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:28 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.434s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:28 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Deleted volume successfully. Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a3eaab18-9853-476e-9e29-46c1306c4fd3 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-06c8cdbc-66ec-499d-9018-44c1471f0f1e-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:28 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.info" returned: 0 in 0.428s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-90b5140d-8b14-4f49-8f11-a3d66e9504f4" by "_copy_volume_from_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-90b5140d-8b14-4f49-8f11-a3d66e9504f4" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] snapshot: 2577a23d-2dd6-4bae-b5e4-4620fb1de251, volume: 90b5140d-8b14-4f49-8f11-a3d66e9504f4, {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f351f67c-b64d-4c7b-9125-e7933c2d1ccb]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:28 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 Feb 27 22:32:28 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-e9a781d2-aa5e-4d0d-be92-a1ccf273482d-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-e9a781d2-aa5e-4d0d-be92-a1ccf273482d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-quobyte-e9a781d2-aa5e-4d0d-be92-a1ccf273482d" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-e9a781d2-aa5e-4d0d-be92-a1ccf273482d" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[380e0318-4b3d-4734-8f7c-f273f0921bfe]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:28 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:28 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d Feb 27 22:32:28 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:29 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251" returned: 0 in 0.530s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Creating direct copy from snapshot {{(pid=83540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0295a0f8-a4c8-4547-9c8a-3c2e67cee380]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:29 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 Feb 27 22:32:29 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:29 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d" returned: 0 in 0.572s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:29 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d Feb 27 22:32:29 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:29 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" returned: 0 in 0.562s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG cinder.utils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Path /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 not found in is_blk_device check {{(pid=83540) is_blk_device /opt/stack/cinder/cinder/utils.py:626}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:29 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 Feb 27 22:32:29 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:29 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-e9a781d2-aa5e-4d0d-be92-a1ccf273482d" returned: 0 in 0.536s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:29 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-e9a781d2-aa5e-4d0d-be92-a1ccf273482d" released by "delete_volume" :: held 1.138s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:30 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created reservations ['3ff28a88-8168-4b6a-a844-81f3f9ecbc03', '765a146d-7b6b-404e-a877-e7ff68c5bf14', '624406eb-f363-46f5-8613-bc87c649a472', '9eea9d9d-9f70-4fd0-9c3c-ceedc7350fca'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:30 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:30 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:30 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:30 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:31 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 1.058s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:31 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Deleted volume successfully. Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-5153179f-03a7-414c-831d-a0dc5717f9a2 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-e9a781d2-aa5e-4d0d-be92-a1ccf273482d-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-46426363-4883-42b5-a4fe-d04758f257a6-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-46426363-4883-42b5-a4fe-d04758f257a6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-quobyte-46426363-4883-42b5-a4fe-d04758f257a6" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-46426363-4883-42b5-a4fe-d04758f257a6" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5df1b8-29ea-4e7d-a04a-8f99c0529e8f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:31 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:31 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 Feb 27 22:32:31 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:32 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4" returned: 0 in 2.429s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6454b489-1d4f-4477-bb36-55d17e658df8]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:32 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 Feb 27 22:32:32 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:32 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6" returned: 0 in 0.923s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:32 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6 Feb 27 22:32:32 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:32 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" returned: 0 in 0.703s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG cinder.image.image_utils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Image conversion details: src /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80, size 1024.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 {{(pid=83540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 22:32:32 devstack cinder-volume[83540]: INFO cinder.image.image_utils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Converted 1024.00 MB image at 421.29 MB/s Feb 27 22:32:32 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 is being set with open permissions: ugo+rw Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:32 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 Feb 27 22:32:32 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:32 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-46426363-4883-42b5-a4fe-d04758f257a6" returned: 0 in 0.467s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-46426363-4883-42b5-a4fe-d04758f257a6" released by "delete_volume" :: held 1.431s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created reservations ['f5366480-c52c-445b-a8e5-493a1751ea82', 'e475165a-11e2-433c-b303-5396ff8f5275', '3e1db344-5e91-4a45-a662-9a5f78bdce04', '15027240-145e-40fb-9181-1cb592064287'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:32 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:33 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:33 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:33 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4" returned: 0 in 0.494s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-90b5140d-8b14-4f49-8f11-a3d66e9504f4" released by "_copy_volume_from_snapshot" :: held 4.768s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-2577a23d-2dd6-4bae-b5e4-4620fb1de251" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-2577a23d-2dd6-4bae-b5e4-4620fb1de251" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Deleting offline snapshot 2577a23d-2dd6-4bae-b5e4-4620fb1de251 of volume dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] snapshot_file for this snap is: volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[41465b99-98b1-4fed-a07b-2b5e4cc70ada]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:33 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 Feb 27 22:32:33 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:33 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.500s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:33 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Deleted volume successfully. Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-0d2d2c31-770a-469c-a70a-2ca9f1d9b464 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-46426363-4883-42b5-a4fe-d04758f257a6-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-quobyte-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5" acquired by "delete_volume" :: waited 0.018s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d27b31a-b488-4322-807d-bde358fc74d1]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:33 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 Feb 27 22:32:33 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:33 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251" returned: 0 in 0.529s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8815e3e7-b567-41df-ace0-0aa5b8aafc8d]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:33 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:34 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 Feb 27 22:32:34 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:34 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5" returned: 0 in 0.598s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:34 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5 Feb 27 22:32:34 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:34 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" returned: 0 in 0.586s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:34 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 Feb 27 22:32:34 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:34 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5" released by "delete_volume" :: held 1.157s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created reservations ['c8e8d6a2-2abe-44cd-a7f1-a17bcc9ef042', 'e7dd0544-6f61-41aa-92c2-2f6e9a5ed96b', '8d28a58f-b5e1-4d77-8d14-107336ff9f20', 'e851adc6-75d9-4a55-8013-3dffce0a02f1'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:34 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:34 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:34 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:35 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251" returned: 0 in 0.582s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:35 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251 Feb 27 22:32:35 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:35 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.528s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:35 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Deleted volume successfully. Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-a193fcde-8283-4a9a-8f41-2128fdecb711 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-3223fcc4-ba3f-4f67-b7b7-08709e2cdef5-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:35 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80.2577a23d-2dd6-4bae-b5e4-4620fb1de251" returned: 0 in 0.495s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-2577a23d-2dd6-4bae-b5e4-4620fb1de251" released by "_delete_snapshot" :: held 2.297s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.154s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.876s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefa2b5d-0b85-4303-823a-9f59850f8914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495204ad23a84862b8c81727ffdb5e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:18Z,use_quota=True,user_id='34fd851666c7432882149da1bf63444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Creating volume eefa2b5d-0b85-4303-823a-9f59850f8914 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:35 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e09c75-b227-4c05-b44e-a58f0d47ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4', 'volume_size': 1, 'source_volid': 'dcdddd79-1f4a-40df-a68f-2dbbfd945a80', 'source_volstatus': 'available'}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:35 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 1073741824 Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3478391-ced9-467a-816f-8d3d9874ca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:35 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:35 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Volume volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 (90b5140d-8b14-4f49-8f11-a3d66e9504f4): created successfully Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3478391-ced9-467a-816f-8d3d9874ca3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Flow 'volume_create_manager' (e3cdabc0-50d6-47bc-992a-8ac2eeacb11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:35 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-25c3fc31-ad53-415f-ab2d-81e4bef85522 tempest-VolumeDependencyTests-522888339 None] Created volume successfully. Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-af9c9146-efd2-4f6f-b0eb-51b1eddf8180-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-af9c9146-efd2-4f6f-b0eb-51b1eddf8180-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-quobyte-af9c9146-efd2-4f6f-b0eb-51b1eddf8180" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-af9c9146-efd2-4f6f-b0eb-51b1eddf8180" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1a3201-e870-4a3c-818e-d759ae1963b2]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:35 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:35 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 Feb 27 22:32:35 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:36 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 1073741824" returned: 0 in 0.532s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:36 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 Feb 27 22:32:36 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:36 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180" returned: 0 in 0.491s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:36 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180 Feb 27 22:32:36 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-dcdddd79-1f4a-40df-a68f-2dbbfd945a80-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Lock "cinder-dcdddd79-1f4a-40df-a68f-2dbbfd945a80-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e70135-5894-494a-b27b-439cb358ce08]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:36 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 Feb 27 22:32:36 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:36 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914" returned: 0 in 0.433s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40fa58e-d437-4992-b4f8-2e086801b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefa2b5d-0b85-4303-823a-9f59850f8914', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17aae1af-f22b-4810-9395-92593878e546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:36 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Volume volume-eefa2b5d-0b85-4303-823a-9f59850f8914 (eefa2b5d-0b85-4303-823a-9f59850f8914): created successfully Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17aae1af-f22b-4810-9395-92593878e546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Flow 'volume_create_manager' (f059442a-908c-46a6-9f44-c7c4ddab9542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:36 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-891c3e0d-36d1-48cd-b427-e8c9f57790f0 tempest-CinderUnicodeTest-1722062543 None] Created volume successfully. Feb 27 22:32:36 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-af9c9146-efd2-4f6f-b0eb-51b1eddf8180" returned: 0 in 0.423s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-af9c9146-efd2-4f6f-b0eb-51b1eddf8180" released by "delete_volume" :: held 0.940s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created reservations ['a02d7d34-c2f7-48ee-94c1-4502f910110e', '5cae1ac4-cc2c-4bf9-8545-5b15f021ebf2', '20214c49-af50-4355-9ba8-a2165fa8a0c1', '9f8d8b0e-4d64-4bb7-8510-b32ae7da2c71'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:36 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:36 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-9eb42b9b-1d04-4a02-8ec6-7de598cd1003-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-9eb42b9b-1d04-4a02-8ec6-7de598cd1003-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-quobyte-de896f3d-9c89-46a1-a7f8-f93d658cde4b" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-de896f3d-9c89-46a1-a7f8-f93d658cde4b" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-quobyte-9eb42b9b-1d04-4a02-8ec6-7de598cd1003" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-9eb42b9b-1d04-4a02-8ec6-7de598cd1003" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:36 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Deleting offline snapshot 9eb42b9b-1d04-4a02-8ec6-7de598cd1003 of volume de896f3d-9c89-46a1-a7f8-f93d658cde4b {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] snapshot_file for this snap is: volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c827f3b-d66a-42d6-a5cb-90cb86f36a5f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:37 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" returned: 0 in 0.519s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:37 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80 Feb 27 22:32:37 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:37 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 Feb 27 22:32:37 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:37 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.427s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:37 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Deleted volume successfully. Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7b61c25-a583-4e19-87ac-056d5829487e tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-af9c9146-efd2-4f6f-b0eb-51b1eddf8180-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:37 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-dcdddd79-1f4a-40df-a68f-2dbbfd945a80" released by "delete_volume" :: held 0.996s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Created reservations ['f189afb7-755a-484c-802c-a2def2e5b59a', '3743222e-3986-43bf-b943-b33cd43e286f', '507a3d2f-267a-422c-b5e3-7b37f77e605d', '4f2e4211-d2c1-412f-91eb-6bd3aacb12ba'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:37 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003" returned: 0 in 0.511s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d757c7a-e01d-4f88-8af4-2391bf27e9de]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:37 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:37 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:37 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:37 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b Feb 27 22:32:37 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:38 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b" returned: 0 in 0.493s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:38 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.470s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:38 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Deleted volume successfully. Feb 27 22:32:38 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 Feb 27 22:32:38 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-312abac8-a10a-4246-94da-d080cf393f5e tempest-VolumeDependencyTests-522888339 None] Lock "cinder-dcdddd79-1f4a-40df-a68f-2dbbfd945a80-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.flows.manager.create_volume [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Flow 'volume_create_manager' (7d15692d-9d9d-4d77-9687-feb00698b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c043bb3-40c0-4034-bb4e-d2941ba7b08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c043bb3-40c0-4034-bb4e-d2941ba7b08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1455380163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e237288-2e57-4ed5-b90b-30379ac9fe93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495204ad23a84862b8c81727ffdb5e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:38Z,use_quota=True,user_id='34fd851666c7432882149da1bf63444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a679c39-dcf8-4aa9-b804-fb95485ba170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a679c39-dcf8-4aa9-b804-fb95485ba170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69332736-4b51-4307-b974-a341b62f314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69332736-4b51-4307-b974-a341b62f314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e237288-2e57-4ed5-b90b-30379ac9fe93', 'volume_name': 'volume-4e237288-2e57-4ed5-b90b-30379ac9fe93', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7402e7-2e71-4d7d-9c02-38ec45aadcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7402e7-2e71-4d7d-9c02-38ec45aadcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66021c04-9ab6-499a-a141-1870b6beb3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:38 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Volume 4e237288-2e57-4ed5-b90b-30379ac9fe93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e237288-2e57-4ed5-b90b-30379ac9fe93', 'volume_size': 1} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T21:32:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1455380163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e237288-2e57-4ed5-b90b-30379ac9fe93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495204ad23a84862b8c81727ffdb5e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T21:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T21:32:38Z,use_quota=True,user_id='34fd851666c7432882149da1bf63444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa344c4f-64c8-4f5d-a82c-20321dddad95),volume_type_id=aa344c4f-64c8-4f5d-a82c-20321dddad95)}" {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Creating volume 4e237288-2e57-4ed5-b90b-30379ac9fe93 {{(pid=83540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Selected osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 as target Quobyte volume. {{(pid=83540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 22:32:38 devstack cinder-volume[83540]: INFO cinder.volume.drivers.remotefs [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] casted to osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6 Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 1073741824 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:38 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 1073741824 Feb 27 22:32:38 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:38 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003" returned: 0 in 0.438s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:38 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003 Feb 27 22:32:38 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-90b5140d-8b14-4f49-8f11-a3d66e9504f4-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Lock "cinder-90b5140d-8b14-4f49-8f11-a3d66e9504f4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-90b5140d-8b14-4f49-8f11-a3d66e9504f4" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-90b5140d-8b14-4f49-8f11-a3d66e9504f4" acquired by "delete_volume" :: waited 0.007s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ebb243-96ae-4a4f-a8c5-345d16ae7c5c]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:38 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 1073741824" returned: 0 in 0.568s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:38 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 Feb 27 22:32:38 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:38 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 Feb 27 22:32:38 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:38 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b.9eb42b9b-1d04-4a02-8ec6-7de598cd1003" returned: 0 in 0.447s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-9eb42b9b-1d04-4a02-8ec6-7de598cd1003" released by "_delete_snapshot" :: held 1.952s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-de896f3d-9c89-46a1-a7f8-f93d658cde4b" released by "delete_snapshot" :: held 1.966s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:38 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created reservations ['564c383a-f9cc-4d58-9110-c5866202c4cc', '00af1126-004a-4e5f-8e59-debcf50d985e', 'bc883066-a2dc-4766-b4cd-d716575f7166', '9476b094-50bb-4c12-b591-1250a7a2eaaf'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:39 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Delete snapshot completed successfully. Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-4de5d6ed-0f2a-4219-a506-c7dfb3b30722 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-9eb42b9b-1d04-4a02-8ec6-7de598cd1003-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-de896f3d-9c89-46a1-a7f8-f93d658cde4b-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-de896f3d-9c89-46a1-a7f8-f93d658cde4b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "cinder-quobyte-de896f3d-9c89-46a1-a7f8-f93d658cde4b" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-de896f3d-9c89-46a1-a7f8-f93d658cde4b" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef77f7d-4fde-472e-abbc-9ee153694f90]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:39 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4" returned: 0 in 0.525s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:39 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4 Feb 27 22:32:39 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:39 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93" returned: 0 in 0.503s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'} {{(pid=83540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:39 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b Feb 27 22:32:39 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66021c04-9ab6-499a-a141-1870b6beb3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e237288-2e57-4ed5-b90b-30379ac9fe93', 'volume_size': 1}' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b9f3c1-10bc-4705-9d42-3da66b537e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 22:32:39 devstack cinder-volume[83540]: INFO cinder.volume.flows.manager.create_volume [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Volume volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 (4e237288-2e57-4ed5-b90b-30379ac9fe93): created successfully Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b9f3c1-10bc-4705-9d42-3da66b537e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83540) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Flow 'volume_create_manager' (7d15692d-9d9d-4d77-9687-feb00698b47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83540) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 22:32:39 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-711e1183-be10-43ff-8025-1b92bb160606 tempest-CinderUnicodeTest-1722062543 None] Created volume successfully. Feb 27 22:32:39 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b" returned: 0 in 0.472s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:39 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-90b5140d-8b14-4f49-8f11-a3d66e9504f4" returned: 0 in 0.453s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-90b5140d-8b14-4f49-8f11-a3d66e9504f4" released by "delete_volume" :: held 1.003s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:39 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b Feb 27 22:32:39 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Created reservations ['075dead3-603f-4fca-bb92-90c27a25df86', '518eb0b5-ea48-4af6-b479-0ef62a70e2ea', '5127abef-1c32-4b6b-b5bb-cc40d4c27c08', '57cced3d-5ecc-4cf4-a2a0-c87aa9466581'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:39 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:39 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:39 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:40 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-de896f3d-9c89-46a1-a7f8-f93d658cde4b" returned: 0 in 0.451s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-quobyte-de896f3d-9c89-46a1-a7f8-f93d658cde4b" released by "delete_volume" :: held 0.959s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Created reservations ['1b463023-fac9-4bfd-8810-95f084b872cf', 'ff63fae1-1410-4cdc-9795-747aa2d6c484', 'a8c27711-336f-4faf-8887-d2d9149bc4ff', '1563b2cc-2738-436d-b493-a5305ba2f831'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:40 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.409s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:40 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Deleted volume successfully. Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-cebe7d74-7a2a-4fb5-bc1a-88960e4968ca tempest-VolumeDependencyTests-522888339 None] Lock "cinder-90b5140d-8b14-4f49-8f11-a3d66e9504f4-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:40 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:40 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Creating offline snapshot bb100d4b-e949-4c45-9046-44d8493bcaa1 of volume 4e237288-2e57-4ed5-b90b-30379ac9fe93 {{(pid=83540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3293c420-0dbe-4503-85ee-112a264e8cb3]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:40 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 Feb 27 22:32:40 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:40 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.481s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:40 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Deleted volume successfully. Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-66dea8cf-e5f8-4df7-b334-f995d5200896 tempest-CreateVolumesFromSnapshotTest-1673649529 None] Lock "cinder-de896f3d-9c89-46a1-a7f8-f93d658cde4b-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-c5f5abed-4708-4087-be38-961beea9f1f9-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Lock "cinder-c5f5abed-4708-4087-be38-961beea9f1f9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Acquiring lock "cinder-quobyte-c5f5abed-4708-4087-be38-961beea9f1f9" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-c5f5abed-4708-4087-be38-961beea9f1f9" acquired by "delete_volume" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b65e02-766a-42d5-a4ec-b3cdeb5c9331]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:40 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:40 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:40 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:40 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 Feb 27 22:32:40 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:41 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93" returned: 0 in 0.559s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 1G {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:41 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 1G Feb 27 22:32:41 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:41 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:41 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.486s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9" returned: 0 in 0.541s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Running periodic task VolumeManager._thread_info {{(pid=83540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 22:32:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task [None req-2abdde2e-fc8c-455f-93c8-fce05cc9a483 None None] Error during VolumeManager._thread_info: TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:32:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Traceback (most recent call last): Feb 27 22:32:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks Feb 27 22:32:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task task(self, context) Feb 27 22:32:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task TypeError: VolumeManager._thread_info() takes 1 positional argument but 2 were given Feb 27 22:32:41 devstack cinder-volume[83540]: ERROR oslo_service.periodic_task Feb 27 22:32:41 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9 Feb 27 22:32:41 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:41 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 1G" returned: 0 in 0.569s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:41 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 Feb 27 22:32:41 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:41 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-c5f5abed-4708-4087-be38-961beea9f1f9" returned: 0 in 0.449s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Lock "cinder-quobyte-c5f5abed-4708-4087-be38-961beea9f1f9" released by "delete_volume" :: held 1.024s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:UPDATE=290,cinder:SELECT=191,cinder:INSERT=50,cinder:DELETE=25 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=198,cinder:UPDATE=256,cinder:INSERT=78,cinder:DELETE=25 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Created reservations ['6da67725-7a58-4043-9a80-2c3b141ffa9a', '34950b4a-04af-439a-a65c-0317b3ff8341', '071d692e-cb1f-4ab8-a710-f6fcf3431e91', 'af7d5b9f-58e9-4cff-b039-fa72cbc85345'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:41 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:42 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:42 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:42 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 -F qcow2 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1" returned: 0 in 0.451s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:42 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 is being set with open permissions: ugo+rw Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:42 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 Feb 27 22:32:42 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:42 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.418s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:42 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Deleted volume successfully. Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-09115d06-a9df-45b3-b4a8-e36da67eb9a8 tempest-VolumeDependencyTests-522888339 None] Lock "cinder-c5f5abed-4708-4087-be38-961beea9f1f9-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:42 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1" returned: 0 in 0.426s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:42 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.info Feb 27 22:32:42 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:42 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.info" returned: 0 in 0.419s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:42 devstack cinder-volume[83540]: WARNING cinder.volume.drivers.remotefs [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.info is being set with open permissions: ugo+rw Feb 27 22:32:42 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.info {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:42 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.info Feb 27 22:32:42 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:43 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.info" returned: 0 in 0.431s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:43 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-74cf64a4-a7f8-4bf7-ac40-6d77b9c78b50 tempest-CinderUnicodeTest-1722062543 None] Create snapshot completed successfully Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "cinder-bb100d4b-e949-4c45-9046-44d8493bcaa1-delete_snapshot" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-bb100d4b-e949-4c45-9046-44d8493bcaa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "cinder-quobyte-4e237288-2e57-4ed5-b90b-30379ac9fe93" by "delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-quobyte-4e237288-2e57-4ed5-b90b-30379ac9fe93" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "cinder-quobyte-bb100d4b-e949-4c45-9046-44d8493bcaa1" by "_delete_snapshot" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-quobyte-bb100d4b-e949-4c45-9046-44d8493bcaa1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Deleting offline snapshot bb100d4b-e949-4c45-9046-44d8493bcaa1 of volume 4e237288-2e57-4ed5-b90b-30379ac9fe93 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] snapshot_file for this snap is: volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 {{(pid=83540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e523f09d-7e31-402c-acca-2d07b4220dad]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:43 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:43 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 Feb 27 22:32:43 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:44 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1" returned: 0 in 0.563s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:44 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.remotefs [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e237288-2e57-4ed5-b90b-30379ac9fe93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 22:32:44 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a86c1-bf9e-419b-89a0-94c90368de0f]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:44 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 Feb 27 22:32:44 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:44 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93" returned: 0 in 0.533s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:44 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:44 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 Feb 27 22:32:44 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:45 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1" returned: 0 in 0.431s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:45 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1 Feb 27 22:32:45 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:45 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:45 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93.bb100d4b-e949-4c45-9046-44d8493bcaa1" returned: 0 in 0.394s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-quobyte-bb100d4b-e949-4c45-9046-44d8493bcaa1" released by "_delete_snapshot" :: held 1.983s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-quobyte-4e237288-2e57-4ed5-b90b-30379ac9fe93" released by "delete_snapshot" :: held 1.997s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:45 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Created reservations ['bc02f823-4d50-4678-937c-40712d7d8fd9', '5efbce92-2ba8-4f8b-ae4d-6a52a66138ed', '6931b578-0533-4ed4-93f0-4b881a469664', '67bd49f1-8add-4f80-b312-05780b740e23'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:45 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Delete snapshot completed successfully. Feb 27 22:32:45 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-f7559232-d4b5-4a85-98fa-1b2f66cedde6 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-bb100d4b-e949-4c45-9046-44d8493bcaa1-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "cinder-4e237288-2e57-4ed5-b90b-30379ac9fe93-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-4e237288-2e57-4ed5-b90b-30379ac9fe93-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "cinder-quobyte-4e237288-2e57-4ed5-b90b-30379ac9fe93" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:46 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-quobyte-4e237288-2e57-4ed5-b90b-30379ac9fe93" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:46 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ea1255-95ba-4091-9847-12a51e48f0ce]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:46 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:46 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 Feb 27 22:32:46 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:47 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93" returned: 0 in 0.449s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:47 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93 Feb 27 22:32:47 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:47 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-4e237288-2e57-4ed5-b90b-30379ac9fe93" returned: 0 in 0.385s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-quobyte-4e237288-2e57-4ed5-b90b-30379ac9fe93" released by "delete_volume" :: held 0.870s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Created reservations ['df10fd41-9803-4ac4-b273-da145e67b062', '5e44d491-cebf-4571-a315-8b06ada794c6', '42cf908b-a064-492f-8649-f65d6b2b46ee', 'de7205de-4ebd-44e5-8d50-1db3d6586efa'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:47 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:47 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "cinder-eefa2b5d-0b85-4303-823a-9f59850f8914-delete_volume" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-eefa2b5d-0b85-4303-823a-9f59850f8914-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "cinder-quobyte-eefa2b5d-0b85-4303-823a-9f59850f8914" by "delete_volume" {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-quobyte-eefa2b5d-0b85-4303-823a-9f59850f8914" acquired by "delete_volume" :: waited 0.008s {{(pid=83540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a1383c-f3f9-4e14-8c8d-7bc2a9c81f9a]: (4, 'qcow2') {{(pid=84523) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 22:32:47 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:47 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 Feb 27 22:32:47 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:48 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.446s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:48 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Deleted volume successfully. Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-8a528cfe-e3fe-47be-968e-4d8ef7667ce1 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-4e237288-2e57-4ed5-b90b-30379ac9fe93-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:48 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914" returned: 0 in 0.468s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:48 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914 Feb 27 22:32:48 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:48 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304/volume-eefa2b5d-0b85-4303-823a-9f59850f8914" returned: 0 in 0.398s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-quobyte-eefa2b5d-0b85-4303-823a-9f59850f8914" released by "delete_volume" :: held 0.888s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG cinder.quota [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Created reservations ['f98a6b35-1fc9-4141-85f0-7f4249860187', '9f14c22a-f29e-473e-99c9-ccae47e1ea2b', '1307812a-a50c-41f0-b40f-545c22fefcfe', '990a4d29-76d4-456d-9487-2ad310423843'] {{(pid=83540) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6': None} {{(pid=83540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG cinder.volume.drivers.quobyte [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b962617d-f826-4861-bda8-9e1446d9bbc6'] {{(pid=83540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.lockutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 22:32:48 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 22:32:48 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304 Feb 27 22:32:48 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 22:32:49 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Feb 27 22:32:49 devstack cinder-volume[83540]: DEBUG oslo_concurrency.processutils [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41a6d6f2cfa60e0146dba725fd9da304" returned: 0 in 0.490s {{(pid=83540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 22:32:49 devstack cinder-volume[83540]: DEBUG cinder.manager [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Notifying Schedulers of capabilities ... {{(pid=83540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:201}} Feb 27 22:32:49 devstack cinder-volume[83540]: INFO cinder.volume.manager [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Deleted volume successfully. Feb 27 22:32:49 devstack cinder-volume[83540]: DEBUG cinder.coordination [None req-3286a9d5-24ce-45b1-98b4-577ccf4062c1 tempest-CinderUnicodeTest-1722062543 None] Lock "cinder-eefa2b5d-0b85-4303-823a-9f59850f8914-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=83540) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 22:32:58 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=21,cinder:INSERT=10,cinder:UPDATE=29 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 22:32:59 devstack cinder-volume[83540]: DEBUG dbcounter [-] [83540] Writing DB stats cinder:SELECT=21,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=4 {{(pid=83540) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}